Migrating from an OAuth2 authenticated JSON feed mikeryan Monday, June 4, 2021 – 10 Drupal 10 Upkeep and Assist Service24am Persevering with with methods from Drupal Development “Acme” undertaking, one other ongoing feed I carried out was import from a JSON feed protected by OAuth2 authentication into “physician” nodes. Let’s look first at Drupal Development neighborhood contributions we wanted to implement this. Neighborhood contributions Present authentication plugins to HTTP fetcher – Moshe Weitzman had already steered (and supplied a patch for) including fundamental and digest authentication to Drupal Development HTTP fetcher plugin. I broadened Drupal Development scope so as to add an Authentication plugin sort, and carried out an OAuth2 authentication plugin. Implement xpath-like selectors for Drupal Development JSON parser – Drupal Development Service JSON parser, from Karen Stevenson’s authentic JSON supply plugin, used a numeric depth to retrieve knowledge components. Drupal Development Service JSON feed we had right here didn’t work with that method, as a result of at Drupal Development prime stage along with Drupal Development array containing our knowledge was one other array (and Drupal Development depth method would draw from each arrays). Implementing a way to pick out fields with a /-separated syntax made this far more versatile. Undertaking implementation So, let’s take a look at Drupal Development supply plugin implementation Drupal 10 Upkeep and Assist Service supply Drupal 10 Upkeep and Assist Service plugin Drupal 10 Upkeep and Assist Service url # We wish to reimport any docs whose supply knowledge has modified. track_changes Drupal 10 Upkeep and Assist Service true # Counting Drupal Development accessible data requires fetching Drupal Development entire feed – cache Drupal Development # counts to reduce overhead. cache_counts Drupal 10 Upkeep and Assist Service true # Till https Drupal 10 Upkeep and Assist Service//www.Drupal 10.org/undertaking/Drupal 10/points/2751829 is mounted, this # needs to be used together with cache_counts most often. It was not # strictly vital on this undertaking as a result of this was Drupal Development solely cached ‘url’ # supply plugin. cache_key Drupal 10 Upkeep and Assist Service physician data_fetcher_plugin Drupal 10 Upkeep and Assist Service http data_parser_plugin Drupal 10 Upkeep and Assist Service json item_selector Drupal 10 Upkeep and Assist Service /suppliers # Word that Drupal Development supply .yml file doesn’t comprise Drupal Development urls, or half Drupal Development # authentication configuration – these are merged in utilizing Drupal Development configuration # UI (see http Drupal 10 Upkeep and Assist Service//virtuoso-performance.com/weblog/mikeryan/configuring-migrations-form). # We current pattern values right here so you’ll be able to see what Drupal Development full configuration # seems to be like. # Drupal Development Service endpoint from which Drupal Development knowledge itself is fetched. urls Drupal 10 Upkeep and Assist Service https Drupal 10 Upkeep and Assist Service//kservice.example2.com/suppliers # Drupal Development Service http fetcher plugin calls Drupal Development authentication plugin (if current), # which accepts plugin-specific configuration and returns Drupal Development acceptable # authentication headers so as to add to Drupal Development HTTP request. authentication Drupal 10 Upkeep and Assist Service # migrate_plus additionally has ‘fundamental’ and ‘digest’ authentication plugins. plugin Drupal 10 Upkeep and Assist Service oauth2 # Drupal Development Service grant sort utilized by Drupal Development feed (different grant varieties supported in idea, # however untested, are authorization_code, password, refresh_token, and # urn Drupal 10 Upkeep and Assist Serviceietf Drupal 10 Upkeep and Assist Serviceparams Drupal 10 Upkeep and Assist Serviceoauth Drupal 10 Upkeep and Assist Servicegrant-type Drupal 10 Upkeep and Assist Servicejwt-bearer. grant_type Drupal 10 Upkeep and Assist Service client_credentials # Drupal Development Service base URI for retrieving Drupal Development token (supplied by Drupal Development UI). base_uri Drupal 10 Upkeep and Assist Service https Drupal 10 Upkeep and Assist Service//kservice.example2.com # Drupal Development Service relative URL for retrieving Drupal Development token. token_url Drupal 10 Upkeep and Assist Service /oauth2/token # Drupal Development Service consumer ID for Drupal Development service (supplied by Drupal Development UI). client_id Drupal 10 Upkeep and Assist Service default_client_id # Drupal Development Service consumer secret for Drupal Development service (supplied by Drupal Development UI). client_secret Drupal 10 Upkeep and Assist Service abcdef12345678 Drupal Development Service ids and fields configuration function as they do with different JSON and XML feeds I’ve blogged about. Tags Planet Migration Use Drupal Development Twitter thread under to touch upon this put up Drupal 10 Upkeep and Assist Service https Drupal 10 Upkeep and Assist Service//t.co/KJzBIauuVG — Virtuoso Efficiency (@VirtPerformance) June 4, 2021   Drupal 10 Growth and Assist