//TODO

1. Fetch several tweets from twitter API using some keywords and filters

   1. Keywords query is stored here https://github.com/catoverse/yellowjobs-backend/blob/main/data/twitterQuery.json
   2. Twitter API Docs and schema

   Standard search API

   How to use advanced Twitter search queries (with examples!)

2. Validation 1: Remove tweets whose author have <50 followers

3. Parse the tweet

   Parsing Logic

   Mark tweets with a '?' to needManualVerification

   .......

4. Create a final tweet object using the original tweet data and the data generated by parsing the tweet.

   Schema:

   const obj = {
       type: data.type,
       categories: data.categories,
       roles: data.roles,
   
       email: data.emails,
       urls: data.urls,
   
       created_by: tweet.user.name,
       created_on: new Date(tweet.created_at).getTime(),
   
       need_manual_verification: data.need_manual_verification,
   
       tweet_id: tweet.id_str,
       tweet_url: `https://twitter.com/${tweet.user.screen_name}/status/${tweet.id_str}`,
       author_id: tweet.user.id_str,
       text: data.stripped_text,
       likes: tweet.favorite_count,
       retweets: tweet.retweet_count,
       tweet_ast: tweetAst,
       author_followers: tweet.user.followers_count,
     };
   

5. Validation 2: Filter out if the tweet has no roles assigned by the parser.