Twitter-to-Elasticsearch Connector

Prerequisites

You’re going to need the following before you begin:

  • An ObjectRocket for Elasticsearch (2.x) instance in one of the following data centers:
    • US-East (IAD)
    • US-West (SJC)
    • US-Chicago (ORD)
    • US-Dallas (DFW)
    • EU-London (LON)
  • Your Elasticsearch/Kibana ACLs and Users configured
    • Make sure you add your ACLs (IP address whitelisting) and have created either an Admin or Kibana-only user – otherwise you won’t be able to access your Kibana interface to check out the sample Twitter dashboard.
    • To add ACLs or Users, do so by clicking the instance name in the Instances interface to configure your Elasticsearch instance (Note: make sure to add a Kibana ACL as well!)
  • A Twitter developer application created: https://apps.twitter.com/

Create a new Twitter App

  • Create New App

_images/create_twitter_app.png
  • Fill in App Details (you can skip Callback URL).

_images/twitter_app_details.png
  • Keep your Consumer Key and Consumer Secret handy.

_images/twitter_consumer_key.png
  • Create an Access Token.

_images/twitter_access_token.png
  • Keep your OAuth Token and OAuth Secret handy.

_images/twitter_access_token_details.png

Create and configure Twitter connector

  • When in the Connectors interface, click the Add Connector button (don’t forget to create an Elasticsearch 2.x instance first!)

_images/connectors_none.png
  • Select the Twitter connector.

_images/select_twitter.png
  • Name your connector, include your Consumer Key, Consumer Secret, Access Token, and Access Secret.

_images/twitter_details.png
  • Enter a Twitter keyword you want to search for and collect (or multiple keywords, comma separated), and click Test API to validate.

_images/twitter_keywords.png
  • After Test API is successful, select the Target Datastore Selection button.
  • Choose your target Elasticsearch cluster, and either leverage an existing index or create a new one by selecting the Create New Index checkbox and naming your index.
  • Click the Kibana Dashboard link to access Kibana and view the sample Twitter dashboard (Make sure you add your ACLs (IP address whitelisting) and have created either an Admin or Kibana-only user – otherwise you won’t be able to access Kibana)
  • Kibana may ask you to “Configure an index pattern” – if so, click the index name on the left-hand side and proceed.

_images/kibana_configure_index.png