CMS Connector API Guide

New CMS Connector API Guide  

This document serves as a guide for extending the CMS Connector API to support new Content  Management Systems (CMS) and file types. It outlines the process of creating new CMS  packages, updating validator and mapper logic, and handling various file extensions and CMS  configurations in the `/validator` route and `handleFileProcessing` function. The goal is to  maintain a modular and CMS-agnostic architecture, allowing for seamless integration of different  CMS platforms by following a structured approach for validation, processing, and data mapping.  

new icon Creating a Similar CMS Package  

Leuk vinden migration-contentful, migration-sitecoremigration-wordpress 

To support a new CMS (e.g., Drupal), create a new package like this:  

TypeScript

 migration-drupal/

Inside it, implement the required structure:  

TypeScript

// migration-drupal/index.js  

constant validator = (data) => {

 // Validate file format, structure, required fields  

};constant ExtractFiles = async (filePath) => {

 // Unzip or parse content  

};

Als u vragen heeft, neem dan contact op met tso-migration@contentstack.com. 

constant contentTypes = {

 // Drupal-specific content type definitions  

};

constant reference = {

 // Drupal-specific field references  

};

constant extractLocales = (data) => {

 // Return locale array  

};

module.exports = {

 validator,

 ExtractFiles,

 contentTypes,

 referentie,

 extractLocales

};

plugged icon Where It’s Plugged In  

Once your package (e.g., migration-drupal) is ready:  

1. Add it to package.json:  

Als u vragen heeft, neem dan contact op met tso-migration@contentstack.com. 

JSON

“migration-drupal”“file:migration-drupal”

2. Update your validator logic:  

TypeScript

constant { validator: drupalValidator } = vereisen(‘migration-drupal’);

schakelaar (CMSIdentifier) {

 geval ‘drupal-zip’:

 opbrengst drupalValidator({ data });

}

3. Update createMapper logic and Add the case in createMapper switch::  

TypeScript

geval ‘drupal’:

 opbrengst await createDrupalMapper(…);

✅ Samenvatting  

To add a new CMS, simply:  

  • Scaffold a package like migration-drupal 
  • Follow the existing method structure
  • Add it to validator and mapper switch blocks

This keeps the architecture modular and CMS-agnostic, all the explanations provided in  subTabs. 

Als u vragen heeft, neem dan contact op met tso-migration@contentstack.com. 

validator validator Route  

This route is used to validate and process a file (local or from AWS S3), based on file type and CMS configuration.  

✅ Functionaliteit voorbijview  

  • Accepts a GET request to /validator 
  • Bepaalt of de file source is local or from S3
  • Gebaseerd op de file uitbreiding:
    ○ If XML → reads as string
    ○ Else (e.g., ZIP) → reads as binary buffer
  • Calls handle File Processing with file gegevens
  • On success, maps the processed file using create Mapper

toevoegen Where to Add Support for New File Typen  

In this route, file extensions are determined using:  

Javascript-functie

constant fileExt = fileName?.split?.('.')?.pop() ?? ";

Then based on file extension, logic is handled like this:

Javascript-functie

if (fileExt === ‘xml’) {

 // Process XML as string  

anders {

 // Process as buffer (e.g., zip)  

}

If you want to add a new file type, you can add it inside this condition: Als u vragen heeft, neem dan contact op met tso-migration@contentstack.com. 

Javascript-functie

if (fileExt === ‘xml’) {

 // …  

else if (fileExt === ‘yourNewExtension’) {

 // Add logic to read and handle this new file type  

anders {

 // Default processing for binary files  

}

You may also need to extend handleFileProcessing to handle the new file type.  

toevoegen Where to Add Support for New CMS Types  

The cmsType is retrieved from:  

const cmsType = config?.cmsType?.toLowerCase();

Later, this variable is passed to:  

const data = await handle File Processing (file Ext, file Data, cms Type, name);

puntig If you want to add a new CMS, you can extend logic inside handle File Processing or wherever you handle CMS-specific processing.  

Also update:  

createMapper(filePath, projectId, app_token, affix, config); To support your new CMS type, add logic to createMapper to handle it accordingly.  

✅ Samenvatting  

● You can add new file extensions by modifying the fileExt condition  Als u vragen heeft, neem dan contact op met tso-migration@contentstack.com. 

● You can add new CMS types by extending handleFileProcessing and createMapper  

● The system already separates XML (string) and ZIP (buffer) handling — follow that  structure  

validator Hendel File Verwerken  

This document explains how to integrate a new CMS platform into the existing file validation and  processing flow using the functions:  

● handleFileProcessing()  

● validator()  

plugged icon Doel  

The backend currently supports multiple CMS types (like Sitecore, Contentful, WordPress,  AEM). The goal is to validate uploaded files and transform them into a structured format specific  to each CMS.  

The system identifies a CMS + file type pair using this format:  

systeem type-extension → e.g., sitecore-zip, contentful-json, wordpress-xml  

functie icoon Where to Add a New CMS  

Step 1: Update the validator () Function  

Located inside:  

Javascript-functie

constant validator = ({ data, type, extension }: { data: any; type: string; extension: string }) => { … }

Find the switch statement on CMSIdentifier. Each case handles one CMS-type and  file-extension combination.  

puntig To add a new CMS, add a new case in this switch block:

Exampon:  

Als u vragen heeft, neem dan contact op met tso-migration@contentstack.com. 

Javascript-functie

geval ‘newcms-json’: {

 opbrengst newCMSValidator(data); // Your new validation logic  }

Zorg ervoor dat:  

● CMSIdentifier format matches the expected {type}-{extension}  

● The validation function (e.g., newCMSValidator) is imported or defined  

brain You can add multiple variations, like:  

case ‘newcms-zip’:  

case ‘newcms-xml’:

Step 2: Create the Validator Function  

In your project, define the validator logic for the new CMS. Exampon:

Javascript-functie

constant newCMSValidator = (data) => {

 // Your custom validation logic for JSON, ZIP, etc.  

 opbrengst true; // or false if validation fails  

};

snaar Input: This could be:  

● A JSZip object (for zip)  

● Raw XML string  

● JSON object/string  

snaar Output: Boolean (true = valid, false = rejected)  

Als u vragen heeft, neem dan contact op met tso-migration@contentstack.com. 

Step 3: Test with handleFileProcessing()  

The validator() function is used inside handleFileProcessing():

Javascript-functie

if (await validator({ data: zipBuffer, type: cmsType, extension: fileExt })) {  // …  

}

Make sure your new CMS validator is covered in the condition by passing the correct:  

● cmsType (from config.cmsType)  

● fileExt (from the uploaded file)  

✅ Summary Checklist  

Taakomschrijving

Add new case Update validator() switch block  

Implement logic Write your own newCMSValidator function  

Opbrengst  

waar/onwaar  

Ensure validator returns a boolean  

Use correct key Follow type-extension format (e.g., newcms-zip)  

�� Optional: Debugging Tips  

Als u vragen heeft, neem dan contact op met tso-migration@contentstack.com. 

● Log the CMSIdentifier inside validator() to ensure your case is reached.  

● Ensure handleFileProcessing is passing correct fileExt and cmsType.  

Adding Mapper Support for a New CMS  

After validating and processing a file, the backend prepares mapping data using the  createMapper function. This step transforms the extracted content into a standardized format that can be used to generate dummy data and locale mappings in your CMS.  

How Mapping Works (High-Level Flow)  

1. ✅ File is successfully validated and saved (ZIP, XML, JSON, etc.)  

2. pad Path to the processed file is determined:  

Javascript-functie

constant filePath = path.join(__dirname, '..''..'‘extracted_fileS', fileName);

3. brain The createMapper function is invoked:  

Javascript-functie

createMapper(filePath, projectId, app_token, affix, config);

4. logica This function routes logic based on the CMS type (e.g., sitecore, contentful,  wordpress)

structuur createMapper Function – Structure  

Javascript-functie

constant createMapper = asynchroon (

 filePad,

 projectId,

 app_token,

Als u vragen heeft, neem dan contact op met tso-migration@contentstack.com. 

 affix,

 configuratie

) => {

 constant CMSIdentifier = config?.cmsType?.toLowerCase();

 schakelaar (CMSIdentifier) {

 geval ‘sitecore’:

 return await createSitecoreMapper(filePath, projectId, app_token, affix, config);

 geval ‘contentful’:

 return await createContentfulMapper(projectId, app_token, affix, config);  geval ‘wordpress’:

 opbrengst createWordpressMapper(filePath, projectId, app_token, affix);  standaard:

 opbrengst false;

 }

};

systeem Each case corresponds to a CMS and calls its mapper function.  

new icon How to Add a New CMS  

Step 1: Add Case in createMapper  

Add a new case for your CMS identifier:  

Javascript-functie

geval ‘newcms’: {

 return await createNewCMSMapper(filePath, projectId, app_token, affix, config);

Als u vragen heeft, neem dan contact op met tso-migration@contentstack.com. 

}

Step 2: Create the Mapper Function  

Implement a new function like:  

Javascript-functie

constant createNewCMSMapper = asynchroon (filePath, projectId, app_token, affix, config) => {

 // 1. Read and transform file inhoud  

 // 2. Generate field mapping object  

 // 3. Send to /v2/mapper/createDummyData  

 // 4. Generate locale mapping and call /v2/migration/localeMapper  };

Step 3: Make Dummy Data API Call  

Use axios like the existing implementation:  

Javascript-functie

constant config = {

 methode: ‘post’,

 maxBodyLength: Oneindigheid,

 url:

`${process.env.NODE_BACKEND_API}/v2/mapper/createDummyData/${projectId}`,  headers: {

 app_token,

 ‘Content-Type’‘application/json’

 },

 gegevens: JSON.stringify(fieldMapping),

Als u vragen heeft, neem dan contact op met tso-migration@contentstack.com. 

};

constant { data } = await axios.request(config);

if (data?.data?.content_mapper?.lengte) {

 deleteFolderSync(infoMap?.path);

 logger.info(‘Validation success:’, {

 status: HTTP_CODES?.OK,

 message: HTTP_TEXTS?.MAPPER_SAVED,

 });

}

Stap 4: Handle Locale Mapping  

If your CMS supports localization, add this or add en-us as default:  

Javascript-functie

constant mapperConfig = {

 methode: ‘post’,

 maxBodyLength: Oneindigheid,

 url:

`${process.env.NODE_BACKEND_API}/v2/migration/localeMapper/${projectId}`,  headers: {

 app_token,

 ‘Content-Type’‘application/json’

 },

 gegevens: {

Als u vragen heeft, neem dan contact op met tso-migration@contentstack.com. 

 locatie: Array.from(localeData) ?? []

 }

};

await axios.request(mapperConfig);

Het runnen van de upload-api Project on Any Operating  System  

The following instructions will guide you in running the upload-api folder on any operating  system, including Windows and macOS.  

Het starten van de upload-api Project  

There are two methods to start the upload-api project:  

Methode 1:  

 Run the following command from the root directory of your project:  

Schelp

npm run upload

This command will directly start the upload-api pakket.  

Methode 2:  

 Navigeer naar de upload-api directory manually and run the development server:  

Schelp

cd upload-api

npm run start

This approach starts the upload-api from within its own directory.  

Restarting After Termination  

Als u vragen heeft, neem dan contact op met tso-migration@contentstack.com. 

If the project terminates unexpectedly, you can restart it by following the same steps outlined  above. Choose either Method 1 or Method 2 to relaunch the service.  

Als u vragen heeft, neem dan contact op met tso-migration@contentstack.com. 

Documenten / Bronnen

CONTENTSTACK CMS Connector API Guide [pdf] Gebruikershandleiding
CMS Connector API Guide, Connector API Guide, API Guide

Referenties

Laat een reactie achter

Uw e-mailadres wordt niet gepubliceerd. Verplichte velden zijn gemarkeerd *