Automattic/Wordpress Firehose Migration Guide
This page is designed to help you migrate to the Automattic/Wordpress Firehose.
Summary of Changes
- New Endpoint URLs
- Update to Backfill Operation
- Enrichment Deprecation
- Stream Partitioning
New Endpoint URLs
Below are the new endpoint URLs for version 2.0 of the Automattic Firehose:
IntenseDebate - Comments Firehose 2.0:
https://gnip-stream.twitter.com/stream/firehose-comments/accounts/{ACCOUNT_NAME}/publishers/intensedebate/{STREAM_LABEL}.json
IntenseDebate - Votes Firehose 2.0:
https://gnip-stream.twitter.com/stream/firehose-votes/accounts/{ACCOUNT_NAME}/publishers/intensedebate/{STREAM_LABEL}.json
WordPress.com - Comments Firehose 2.0:
https://gnip-stream.twitter.com/stream/firehose-comments/accounts/{ACCOUNT_NAME}/publishers/wordpresscom/{STREAM_LABEL}.json
WordPress.com - Likes Firehose 2.0:
https://gnip-stream.twitter.com/stream/firehose-likes/accounts/{ACCOUNT_NAME}/publishers/wordpresscom/{STREAM_LABEL}.json
WordPress.com - Posts Firehose 2.0:
https://gnip-stream.twitter.com/stream/firehose-posts/accounts/{ACCOUNT_NAME}/publishers/wordpresscom/{STREAM_LABEL}.json
WordPress.org - Comments Firehose 2.0:
https://gnip-stream.twitter.com/stream/firehose-comments/accounts/{ACCOUNT_NAME}/publishers/wordpressorg/{STREAM_LABEL}.json
WordPress.org - Posts Firehose 2.0:
https://gnip-stream.twitter.com/stream/firehose-posts/accounts/{ACCOUNT_NAME}/publishers/wordpressorg/{STREAM_LABEL}.json
Update to Backfill Operation
- You will now need to specify the period of time that they need for missed data (up to 5 min back) vs. the old method where data was automatically provided for the full duration
- More infomration on Backfill can be found HERE
Enrichment Deprecation
- Language Classification
- URL Expansion
Stream Partitioning
- The Automattic/WordPress Firehose is a single partition offering
- A single partition will be specified with the initial stream connection