Data Import

Importing Files into SmartFeeds: Supported Formats and Methods

This guide is for users looking to import various data sources into SmartFeeds and covers supported file formats, import methods, and troubleshooting common XML errors. It will be especially useful for those managing complex product feeds or using third-party data integration on SmartFeeds.

Supported File Formats for Import

SmartFeeds supports the following file formats:

CSV: Delimiters accepted include comma (,), semicolon (;), pipe (|), and tab. Tab-separated files can also use the .tsv extension.
JSON: Only standard JSON files are supported (no NDJSON format).
XML: RSS 2.0 is compatible.
- Custom root tags (e.g., <products> instead of <channel> or <item>) are allowed.
- Child tags are concatenated with their parent.
  Example: <price> <currency>EUR</currency> <value>12</value> </price>
  SmartFeeds Result: price_currency,price_value "EUR,12"
Compressed Files: Gzip (.gz) and Zip (.zip) are supported.

Import Methods

To create an import, go to Product Flow, select + New Data Source, and then choose the import type. Available methods include:

HTTP: Use a standard URL (e.g., https://example.com).

For password-protected URLs, you must whitelist IP 34.76.228.121.

Google Spreadsheet: Share access with adscale@smart-feeds.iam.gserviceaccount.com.
FTP/SFTP: Whitelist IP 104.199.20.232 for server access. For SFTP, add login, password, and optionally, SmartFeeds’ SSH key.
Arcane FTP/SFTP: For new clients, request account setup and provide IPs. Access details:
- SFTP: Host: 35.210.55.132, Port: 2222
- FTP: Host: 35.206.138.148, Port: 21
Shopify API: Provide a token with permissions: read_markets, read_products, etc.
SmartData: Connect Google Analytics or Google Ads accounts for advanced tracking.

Special Import Configurations

Some imports, such as Shopify, PrestaShop, or Magento, may require custom setup. Simply select the appropriate platform symbol in SmartFeeds and follow the instructions.

For XML, Zip, or Gzip files, enable XML File Option under Advanced Settings for XML, and choose the correct Compression Type for Zip/Gzip.

Troubleshooting XML Errors

Errors in XML feeds are often due to special characters like &, <, and >. Here’s how to resolve them:

Open the XML file URL in your browser.
Save the file locally (Ctrl+S).
Use a code editor to locate and correct the problematic line.
Managing Special Characters:
- Use <![CDATA[value]]> to escape special characters.
- In the SQL editor, use CONCAT("<![CDATA[", VALUE, "]]>") to format values.

Actions and Insights on Configured Imports

For each configured import, you can:

Check the last retrieval time and data volume.
Perform actions such as:
- Edit the import configuration.
- Refresh manually.
- Download or explore the data.

Advanced Configuration Tabs

Beyond basic setup, SmartFeeds offers advanced tabs to structure and monitor your data directly at the source:

Detailed History: Enable the Detailed History switch to track the granular evolution of your catalog. This highlights exactly how many items were added, modified, or deleted compared to the previous day. Refer to the Detailed Import History article to learn more.
Managing Field Types: Use the Headers tab to adjust the type of each field (e.g., Text, Integer, Decimal). Correct typing is critical for fields like price to ensure formulas work correctly later in the flow.
Tracking Import Usage: The Use tab displays exactly where this import is currently active across your account. Refer to the Deletion article for guidance on removing unused files safely.
Aggregation: Use the Aggregation tab to restructure your file before it enters the flow. This allows you to group rows or concatenate values (e.g., turning a list of orders into a single client view) without external pre-processing.
Learn more about Aggregation and see how to use it in an audience segmentation use case article.

Quick Answers to Common Issues

What should I do if my file format is unsupported?

Contact SmartFeeds support to see if a solution is available.

Can I manually update an import?

Yes, click the update arrow next to the data source to refresh it.

How do I configure alert settings for imports?

Go to Edit > Import Alerts to adjust notification preferences. Find more information on Product Flow Alerts

Is it possible to preprocess source files before uploading them to SmartFeeds?

Yes, we have the ability to preprocess your source files before uploading them to SmartFeeds. This requires the involvement of our Tech team and may incur additional licensing fees, depending on the complexity of the task.

Use Cases:

Cross-referencing files
Removing duplicates
[Other specific tasks as needed]

If you have specific preprocessing requirements, please contact us for further details and a customized quote.

For further assistance with SmartFeeds, consider reviewing these articles:

For additional help, feel free to reach out via our Contact Us page.