RSS
Overview
The RSS source allows you to read data from any individual RSS feed.
Output schema
This source is capable of syncing the following streams:
items- Provides stats about specific RSS items.
- Most fields are simply kept from RSS items as strings if present (
title,link,description,author,category,comments,enclosure,guid). - The date field is handled differently. It's transformed into a UTC datetime in a
publishedfield for easier use in data warehouses and other destinations. - The RSS feed you're subscribing to must have a valid
pubDatefield for each item for incremental syncs to work properly. - Since
guidis not a required field, there is no primary key for the feed, only a cursor on the published date.
Features
| Feature | Supported? |
|---|---|
| Full Refresh Sync | Yes |
| Incremental - Append Sync | Yes |
| Namespaces | No |
Requirements / Setup Guide
Only the url of an RSS feed is required.
Performance considerations
None
Reference
Config fields reference
Field
Type
Property name
string
url
Changelog
Expand to review
| Version | Date | Pull Request | Subject |
|---|---|---|---|
| 1.0.4 | 2024-06-25 | 40410 | Update dependencies |
| 1.0.3 | 2024-06-22 | 40083 | Update dependencies |
| 1.0.2 | 2024-06-04 | 39085 | [autopull] Upgrade base image to v1.2.1 |
| 1.0.1 | 2024-04-30 | 37535 | Fix incremental sync |
| 1.0.0 | 2024-04-20 | 36418 | Migrate python cdk to low code |
| 0.1.0 | 2022-10-12 | 18838 | Initial release supporting RSS |