Data Import

This guide is for users looking to import various data sources into SmartFeeds and covers supported file formats, import methods, and troubleshooting common XML errors. It will be especially useful for those managing complex product feeds or using third-party data integration on SmartFeeds.

Table of Contents

1. Supported File Formats for Import
2. Import Methods
3. Special Import Configurations
4. Troubleshooting XML Errors
5. Actions and Insights on Configured Imports
6. Quick Answers to Common Issues
7. Related Articles

Supported File Formats for Import

SmartFeeds supports the following file formats:

• CSV: Delimiters accepted include comma (,), semicolon (;), pipe (|), and tab. Tab-separated files can also use the .tsv extension.
• JSON: Only standard JSON files are supported (no NDJSON format).
• XML: RSS 2.0 is compatible. 
  • Custom root tags (e.g., <products> instead of <channel> or <item>) are allowed. 
  • Child tags are concatenated with their parent.
    Example: <price>  <currency>EUR</currency>  <value>12</value> </price>
    SmartFeeds Result: price_currency,price_value "EUR,12"
• Compressed Files: Gzip (.gz) and Zip (.zip) are supported.

Import Methods

To create an import, go to Product Flow, select + New Data Source, and then choose the import type. Available methods include:

• HTTP: Use a standard URL (e.g., https://example.com).

For password-protected URLs, you must whitelist IP 34.76.228.121.

• Google Spreadsheet: Share access with adscale@smart-feeds.iam.gserviceaccount.com.
• FTP/SFTP: Whitelist IP 104.199.20.232 for server access. For SFTP, add login, password, and optionally, SmartFeeds’ SSH key.
• Arcane FTP/SFTP: For new clients, request account setup and provide IPs. Access details:
  • SFTP: Host: 35.210.55.132, Port: 2222
  • FTP: Host: 35.206.138.148, Port: 21
• Shopify API: Provide a token with permissions: read_markets, read_products, etc.
• SmartData: Connect Google Analytics or Google Ads accounts for advanced tracking.

Special Import Configurations

Some imports, such as Shopify, PrestaShop, or Magento, may require custom setup. Simply select the appropriate platform symbol in SmartFeeds and follow the instructions.

For XML, Zip, or Gzip files, enable XML File Option under Advanced Settings for XML, and choose the correct Compression Type for Zip/Gzip.

Troubleshooting XML Errors

Errors in XML feeds are often due to special characters like &, <, and >. Here’s how to resolve them:

1. Open the XML file URL in your browser.
2. Save the file locally (Ctrl+S).
3. Use a code editor to locate and correct the problematic line.
4. Managing Special Characters:
   • Use <![CDATA[value]]> to escape special characters.
   • In the SQL editor, use CONCAT("<![CDATA[", VALUE, "]]>") to format values.

Actions and Insights on Configured Imports

For each configured import, you can:

• Check the last retrieval time and data volume.
• Perform actions such as:
  • Edit the import configuration.
  • Refresh manually.
  • Download or explore the data.

Managing Field Types

During the creation or modification of an import, use the Headers tab to adjust the type of each field. This is especially useful for fields like price, where the correct type is critical.

Tracking Import Usage

The Use tab allows you to see where the import is being used across your configurations. For more information, including guidance on deletion, refer to the article on Deletion.

Quick Answers to Common Issues

What should I do if my file format is unsupported?

Contact SmartFeeds support to see if a solution is available.

Can I manually update an import?

Yes, click the update arrow next to the data source to refresh it.

How do I configure alert settings for imports?

Go to Edit > Import Alerts to adjust notification preferences. Find more information on Product Flow Alerts

Is it possible to preprocess source files before uploading them to SmartFeeds?

Yes, we have the ability to preprocess your source files before uploading them to SmartFeeds. This requires the involvement of our Tech team and may incur additional licensing fees, depending on the complexity of the task.

Use Cases:

• Cross-referencing files
• Removing duplicates
• [Other specific tasks as needed]

If you have specific preprocessing requirements, please contact us for further details and a customized quote.

Related Articles

For further assistance with SmartFeeds, consider reviewing these articles:

• Data Export
• Deletion
• Product Flow Alerts

For additional help, feel free to reach out via our Contact Us page.