{"id":4526,"date":"2013-11-24T16:29:23","date_gmt":"2013-11-24T08:29:23","guid":{"rendered":"http:\/\/maziyar.me\/?p=4526"},"modified":"2015-11-16T11:20:11","modified_gmt":"2015-11-16T09:20:11","slug":"source-of-tweets","status":"publish","type":"post","link":"https:\/\/iscpif.fr\/maziyar\/2013\/11\/24\/source-of-tweets\/","title":{"rendered":"Source of Tweets in France and United States"},"content":{"rendered":"<p style=\"text-align: justify\">So here is the thing: How people are sharing on Twitter around the world? What are the devices or services they usually use to share their check-ins, photos, videos, or updates on Twitter?<\/p>\n<p style=\"text-align: justify\">This is a really simple analytics I did on a data that I&#8217;ve been gathering for almost 2 months now (around 97 million tweets from US and\u00a05.5 million tweets from France by the time of this study) to get some answers for the above question by using Hadoop batch processing.<\/p>\n<p style=\"text-align: justify\">I have 4 EC2 instances up and running 24&#215;7 to track tweets (from Twitter Public Streaming API) and store them into MongoDB Replica Set. One of the nodes is an application server that I built by Node.js stack to process and visualise the stream as it comes to the system in a real-time. Currently I have average of 100 tweets\/s, minimum of 30-40\/s, and maximum of 180-220\/s. There is more than one Twitter account at the same time to tracking tweets by locations and different keywords. That&#8217;s why I get more than 1% of the entire stream sometimes!<\/p>\n<p><!--more--><\/p>\n<p style=\"text-align: justify\">There are few batch processing jobs that I&#8217;d like to do from exported files on S3 by using Amazon EMR cluster and not using any MongoDB aggregations or Redis operations no matter how fast they are only because of their unpredicted behaviours in a long-term processing job. Besides, firing and destroying EMR clusters automatically and analysing big amount of data from S3 is so easy and so cheap that risking of running a long-term MapReduce job or aggregation in a production environment is just out of the question, not that my MongoDB Replica Set instances are that big or good enough for production anyway. In my case Hadoop MapReduce jobs take about 20 minutes plus 4 to 5 minutes to start and spin off the cluster will cost <del>(5 (m2.xLarge instances) * 0.5 (price per hour))\/2 ( since it just takes around 30 minutes) = 5*0.5\/2 = $1.25<\/del>\u00a0which is nothing compare to what we have to pay to beef up three EC2 instances!<\/p>\n<p style=\"text-align: justify\"><strong>UPDATE1:\u00a0<\/strong>I was wrong about the price, I based my calculations regarding to EC2 instances price which it should have been based on EC2 prices plus\u00a0<strong>EMR prices<\/strong>\u00a0as well. Don&#8217;t worry this one will be still cheap enough!<\/p>\n<p style=\"text-align: justify\">So here is the price for the same cluster: (5 * ($0.09+$0.495)\/2 = $1.46 ! So if you fire up the cluster once a day you&#8217;ll end up paying around 44 bucks a month. There is a calculator <a href=\"http:\/\/calculator.s3.amazonaws.com\/calc5.html\" target=\"_blank\">here provided by Amazon<\/a> that you can play with it.<\/p>\n<p style=\"text-align: justify\"><strong>UPDATE2:\u00a0<\/strong>You always pay the entire hour in AWS! There will be no more 30 minutes so optimise your workload to use the entire hour cause you will pay for it anyway \ud83d\ude42<\/p>\n<p style=\"text-align: justify\">I will do more complex analytics on the source of tweets to see the frequency of devices and services during day time and night time. That&#8217;d be cool!.<\/p>\n<p style=\"text-align: justify\">\n<p style=\"text-align: justify\"><a href=\"http:\/\/iscpif.fr\/maziyar\/wp-content\/uploads\/sites\/5\/2015\/06\/US97.png\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-medium wp-image-5136\" src=\"http:\/\/iscpif.fr\/maziyar\/wp-content\/uploads\/sites\/5\/2015\/06\/US97-640x237.png\" alt=\"US97\" width=\"640\" height=\"237\" srcset=\"https:\/\/iscpif.fr\/maziyar\/wp-content\/uploads\/sites\/5\/2015\/06\/US97-640x237.png 640w, https:\/\/iscpif.fr\/maziyar\/wp-content\/uploads\/sites\/5\/2015\/06\/US97-1024x380.png 1024w\" sizes=\"auto, (max-width: 640px) 100vw, 640px\" \/><\/a> <a href=\"http:\/\/iscpif.fr\/maziyar\/wp-content\/uploads\/sites\/5\/2015\/06\/FRTwitterSource.png\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-medium wp-image-5114\" src=\"http:\/\/iscpif.fr\/maziyar\/wp-content\/uploads\/sites\/5\/2015\/06\/FRTwitterSource-640x313.png\" alt=\"FRTwitterSource\" width=\"640\" height=\"313\" srcset=\"https:\/\/iscpif.fr\/maziyar\/wp-content\/uploads\/sites\/5\/2015\/06\/FRTwitterSource-640x313.png 640w, https:\/\/iscpif.fr\/maziyar\/wp-content\/uploads\/sites\/5\/2015\/06\/FRTwitterSource-1024x501.png 1024w\" sizes=\"auto, (max-width: 640px) 100vw, 640px\" \/><\/a><\/p>\n<p style=\"text-align: justify\">\n<p style=\"text-align: justify\">\n","protected":false},"excerpt":{"rendered":"<p>So here is the thing: How people are sharing on Twitter around the world? What are the devices or services they usually use to share their check-ins, photos, videos, or updates on Twitter? This is a really simple analytics I did on a data that I&#8217;ve been gathering for almost 2 months now (around 97 &hellip; <\/p>\n<p class=\"link-more\"><a href=\"https:\/\/iscpif.fr\/maziyar\/2013\/11\/24\/source-of-tweets\/\" class=\"more-link\">Continue reading<span class=\"screen-reader-text\"> &#8220;Source of Tweets in France and United States&#8221;<\/span><\/a><\/p>\n","protected":false},"author":65,"featured_media":4532,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_jetpack_newsletter_access":"","_jetpack_dont_email_post_to_subs":false,"_jetpack_newsletter_tier_id":0,"_jetpack_memberships_contains_paywalled_content":false,"_jetpack_feature_clip_id":0,"_jetpack_memberships_contains_paid_content":false,"footnotes":"","jetpack_publicize_message":"","jetpack_publicize_feature_enabled":true,"jetpack_social_post_already_shared":true,"jetpack_social_options":{"image_generator_settings":{"template":"highway","default_image_id":0,"font":"","enabled":false},"version":2},"jetpack_post_was_ever_published":false},"categories":[7],"tags":[12,14,18,20,25,36,38,42,46],"class_list":["post-4526","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-geeky","tag-aws","tag-bigdata","tag-ec2","tag-emr","tag-hadoop","tag-mongodb","tag-node-js","tag-redis","tag-twitter"],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v27.8 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>Source of Tweets in France and United States - Maziyar PANAHI<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/iscpif.fr\/maziyar\/2013\/11\/24\/source-of-tweets\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Source of Tweets in France and United States - Maziyar PANAHI\" \/>\n<meta property=\"og:description\" content=\"So here is the thing: How people are sharing on Twitter around the world? What are the devices or services they usually use to share their check-ins, photos, videos, or updates on Twitter? This is a really simple analytics I did on a data that I&#8217;ve been gathering for almost 2 months now (around 97 &hellip; Continue reading &quot;Source of Tweets in France and United States&quot;\" \/>\n<meta property=\"og:url\" content=\"https:\/\/iscpif.fr\/maziyar\/2013\/11\/24\/source-of-tweets\/\" \/>\n<meta property=\"og:site_name\" content=\"Maziyar PANAHI\" \/>\n<meta property=\"article:published_time\" content=\"2013-11-24T08:29:23+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2015-11-16T09:20:11+00:00\" \/>\n<meta name=\"author\" content=\"Maziyar\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Maziyar\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"2 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\\\/\\\/iscpif.fr\\\/maziyar\\\/2013\\\/11\\\/24\\\/source-of-tweets\\\/#article\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/iscpif.fr\\\/maziyar\\\/2013\\\/11\\\/24\\\/source-of-tweets\\\/\"},\"author\":{\"name\":\"Maziyar\",\"@id\":\"https:\\\/\\\/iscpif.fr\\\/maziyar\\\/#\\\/schema\\\/person\\\/02ae0118261368c80d32bef0b75f5faf\"},\"headline\":\"Source of Tweets in France and United States\",\"datePublished\":\"2013-11-24T08:29:23+00:00\",\"dateModified\":\"2015-11-16T09:20:11+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\\\/\\\/iscpif.fr\\\/maziyar\\\/2013\\\/11\\\/24\\\/source-of-tweets\\\/\"},\"wordCount\":480,\"image\":{\"@id\":\"https:\\\/\\\/iscpif.fr\\\/maziyar\\\/2013\\\/11\\\/24\\\/source-of-tweets\\\/#primaryimage\"},\"thumbnailUrl\":\"\",\"keywords\":[\"AWS\",\"BigData\",\"EC2\",\"EMR\",\"Hadoop\",\"MongoDB\",\"Node.js\",\"Redis\",\"twitter\"],\"articleSection\":[\"Geeky\"],\"inLanguage\":\"en-US\"},{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/iscpif.fr\\\/maziyar\\\/2013\\\/11\\\/24\\\/source-of-tweets\\\/\",\"url\":\"https:\\\/\\\/iscpif.fr\\\/maziyar\\\/2013\\\/11\\\/24\\\/source-of-tweets\\\/\",\"name\":\"Source of Tweets in France and United States - Maziyar PANAHI\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/iscpif.fr\\\/maziyar\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/iscpif.fr\\\/maziyar\\\/2013\\\/11\\\/24\\\/source-of-tweets\\\/#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/iscpif.fr\\\/maziyar\\\/2013\\\/11\\\/24\\\/source-of-tweets\\\/#primaryimage\"},\"thumbnailUrl\":\"\",\"datePublished\":\"2013-11-24T08:29:23+00:00\",\"dateModified\":\"2015-11-16T09:20:11+00:00\",\"author\":{\"@id\":\"https:\\\/\\\/iscpif.fr\\\/maziyar\\\/#\\\/schema\\\/person\\\/02ae0118261368c80d32bef0b75f5faf\"},\"breadcrumb\":{\"@id\":\"https:\\\/\\\/iscpif.fr\\\/maziyar\\\/2013\\\/11\\\/24\\\/source-of-tweets\\\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/iscpif.fr\\\/maziyar\\\/2013\\\/11\\\/24\\\/source-of-tweets\\\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/iscpif.fr\\\/maziyar\\\/2013\\\/11\\\/24\\\/source-of-tweets\\\/#primaryimage\",\"url\":\"\",\"contentUrl\":\"\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/iscpif.fr\\\/maziyar\\\/2013\\\/11\\\/24\\\/source-of-tweets\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/iscpif.fr\\\/maziyar\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Source of Tweets in France and United States\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/iscpif.fr\\\/maziyar\\\/#website\",\"url\":\"https:\\\/\\\/iscpif.fr\\\/maziyar\\\/\",\"name\":\"Maziyar PANAHI\",\"description\":\"Generative AI Leader in Healthcare\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/iscpif.fr\\\/maziyar\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\\\/\\\/iscpif.fr\\\/maziyar\\\/#\\\/schema\\\/person\\\/02ae0118261368c80d32bef0b75f5faf\",\"name\":\"Maziyar\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/286798afc2f09c77b0ab1a0a60150f989d903d23d84c3eedfb8ebd1da500e5b1?s=96&d=mm&r=g\",\"url\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/286798afc2f09c77b0ab1a0a60150f989d903d23d84c3eedfb8ebd1da500e5b1?s=96&d=mm&r=g\",\"contentUrl\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/286798afc2f09c77b0ab1a0a60150f989d903d23d84c3eedfb8ebd1da500e5b1?s=96&d=mm&r=g\",\"caption\":\"Maziyar\"},\"description\":\"Big Data engineer\",\"sameAs\":[\"https:\\\/\\\/multivac.iscpif.fr\"],\"url\":\"https:\\\/\\\/iscpif.fr\\\/maziyar\\\/author\\\/maziyar-panahi\\\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Source of Tweets in France and United States - Maziyar PANAHI","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/iscpif.fr\/maziyar\/2013\/11\/24\/source-of-tweets\/","og_locale":"en_US","og_type":"article","og_title":"Source of Tweets in France and United States - Maziyar PANAHI","og_description":"So here is the thing: How people are sharing on Twitter around the world? What are the devices or services they usually use to share their check-ins, photos, videos, or updates on Twitter? This is a really simple analytics I did on a data that I&#8217;ve been gathering for almost 2 months now (around 97 &hellip; Continue reading \"Source of Tweets in France and United States\"","og_url":"https:\/\/iscpif.fr\/maziyar\/2013\/11\/24\/source-of-tweets\/","og_site_name":"Maziyar PANAHI","article_published_time":"2013-11-24T08:29:23+00:00","article_modified_time":"2015-11-16T09:20:11+00:00","author":"Maziyar","twitter_card":"summary_large_image","twitter_misc":{"Written by":"Maziyar","Est. reading time":"2 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/iscpif.fr\/maziyar\/2013\/11\/24\/source-of-tweets\/#article","isPartOf":{"@id":"https:\/\/iscpif.fr\/maziyar\/2013\/11\/24\/source-of-tweets\/"},"author":{"name":"Maziyar","@id":"https:\/\/iscpif.fr\/maziyar\/#\/schema\/person\/02ae0118261368c80d32bef0b75f5faf"},"headline":"Source of Tweets in France and United States","datePublished":"2013-11-24T08:29:23+00:00","dateModified":"2015-11-16T09:20:11+00:00","mainEntityOfPage":{"@id":"https:\/\/iscpif.fr\/maziyar\/2013\/11\/24\/source-of-tweets\/"},"wordCount":480,"image":{"@id":"https:\/\/iscpif.fr\/maziyar\/2013\/11\/24\/source-of-tweets\/#primaryimage"},"thumbnailUrl":"","keywords":["AWS","BigData","EC2","EMR","Hadoop","MongoDB","Node.js","Redis","twitter"],"articleSection":["Geeky"],"inLanguage":"en-US"},{"@type":"WebPage","@id":"https:\/\/iscpif.fr\/maziyar\/2013\/11\/24\/source-of-tweets\/","url":"https:\/\/iscpif.fr\/maziyar\/2013\/11\/24\/source-of-tweets\/","name":"Source of Tweets in France and United States - Maziyar PANAHI","isPartOf":{"@id":"https:\/\/iscpif.fr\/maziyar\/#website"},"primaryImageOfPage":{"@id":"https:\/\/iscpif.fr\/maziyar\/2013\/11\/24\/source-of-tweets\/#primaryimage"},"image":{"@id":"https:\/\/iscpif.fr\/maziyar\/2013\/11\/24\/source-of-tweets\/#primaryimage"},"thumbnailUrl":"","datePublished":"2013-11-24T08:29:23+00:00","dateModified":"2015-11-16T09:20:11+00:00","author":{"@id":"https:\/\/iscpif.fr\/maziyar\/#\/schema\/person\/02ae0118261368c80d32bef0b75f5faf"},"breadcrumb":{"@id":"https:\/\/iscpif.fr\/maziyar\/2013\/11\/24\/source-of-tweets\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/iscpif.fr\/maziyar\/2013\/11\/24\/source-of-tweets\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/iscpif.fr\/maziyar\/2013\/11\/24\/source-of-tweets\/#primaryimage","url":"","contentUrl":""},{"@type":"BreadcrumbList","@id":"https:\/\/iscpif.fr\/maziyar\/2013\/11\/24\/source-of-tweets\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/iscpif.fr\/maziyar\/"},{"@type":"ListItem","position":2,"name":"Source of Tweets in France and United States"}]},{"@type":"WebSite","@id":"https:\/\/iscpif.fr\/maziyar\/#website","url":"https:\/\/iscpif.fr\/maziyar\/","name":"Maziyar PANAHI","description":"Generative AI Leader in Healthcare","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/iscpif.fr\/maziyar\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/iscpif.fr\/maziyar\/#\/schema\/person\/02ae0118261368c80d32bef0b75f5faf","name":"Maziyar","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/secure.gravatar.com\/avatar\/286798afc2f09c77b0ab1a0a60150f989d903d23d84c3eedfb8ebd1da500e5b1?s=96&d=mm&r=g","url":"https:\/\/secure.gravatar.com\/avatar\/286798afc2f09c77b0ab1a0a60150f989d903d23d84c3eedfb8ebd1da500e5b1?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/286798afc2f09c77b0ab1a0a60150f989d903d23d84c3eedfb8ebd1da500e5b1?s=96&d=mm&r=g","caption":"Maziyar"},"description":"Big Data engineer","sameAs":["https:\/\/multivac.iscpif.fr"],"url":"https:\/\/iscpif.fr\/maziyar\/author\/maziyar-panahi\/"}]}},"jetpack_publicize_connections":[],"jetpack_featured_media_url":"","jetpack_sharing_enabled":true,"jetpack_shortlink":"https:\/\/wp.me\/p6jMg3-1b0","jetpack-related-posts":[{"id":4493,"url":"https:\/\/iscpif.fr\/maziyar\/2013\/10\/17\/visualising-tweets-on-mapbox\/","url_meta":{"origin":4526,"position":0},"title":"Visualising Tweets on MapBox","author":"Maziyar","date":"October 17, 2013","format":false,"excerpt":"There are the used technologies: #AWS #EC2 #MongoDB #Redis #Nodejs #Socketio #Twitter #MapBox #TileMill \u00a0 \u00a0","rel":"","context":"In &quot;Geeky&quot;","block_context":{"text":"Geeky","link":"https:\/\/iscpif.fr\/maziyar\/category\/geeky\/"},"img":{"alt_text":"Paris","src":"https:\/\/i0.wp.com\/iscpif.fr\/maziyar\/wp-content\/uploads\/sites\/5\/2015\/06\/Paris-640x298.png?resize=350%2C200","width":350,"height":200,"srcset":"https:\/\/i0.wp.com\/iscpif.fr\/maziyar\/wp-content\/uploads\/sites\/5\/2015\/06\/Paris-640x298.png?resize=350%2C200 1x, https:\/\/i0.wp.com\/iscpif.fr\/maziyar\/wp-content\/uploads\/sites\/5\/2015\/06\/Paris-640x298.png?resize=525%2C300 1.5x"},"classes":[]},{"id":4582,"url":"https:\/\/iscpif.fr\/maziyar\/2014\/02\/17\/building-search-engine-by-elasticsearch\/","url_meta":{"origin":4526,"position":1},"title":"Building Search Engine by ElasticSearch","author":"Maziyar","date":"February 17, 2014","format":false,"excerpt":"I've started to work with ElasticSearch for a while now. I gotta say it's a powerful open source for building distributed real-time search engines and analytics engines. It also uses Shards and Replica in distributed machines to make your architecture reliable and scalable. It's not just a simple full-text search\u2026","rel":"","context":"In &quot;Geeky&quot;","block_context":{"text":"Geeky","link":"https:\/\/iscpif.fr\/maziyar\/category\/geeky\/"},"img":{"alt_text":"","src":"https:\/\/i0.wp.com\/iscpif.fr\/maziyar\/wp-content\/uploads\/sites\/5\/2015\/06\/Marvel.png?resize=350%2C200&ssl=1","width":350,"height":200,"srcset":"https:\/\/i0.wp.com\/iscpif.fr\/maziyar\/wp-content\/uploads\/sites\/5\/2015\/06\/Marvel.png?resize=350%2C200&ssl=1 1x, https:\/\/i0.wp.com\/iscpif.fr\/maziyar\/wp-content\/uploads\/sites\/5\/2015\/06\/Marvel.png?resize=525%2C300&ssl=1 1.5x, https:\/\/i0.wp.com\/iscpif.fr\/maziyar\/wp-content\/uploads\/sites\/5\/2015\/06\/Marvel.png?resize=700%2C400&ssl=1 2x, https:\/\/i0.wp.com\/iscpif.fr\/maziyar\/wp-content\/uploads\/sites\/5\/2015\/06\/Marvel.png?resize=1050%2C600&ssl=1 3x, https:\/\/i0.wp.com\/iscpif.fr\/maziyar\/wp-content\/uploads\/sites\/5\/2015\/06\/Marvel.png?resize=1400%2C800&ssl=1 4x"},"classes":[]},{"id":4569,"url":"https:\/\/iscpif.fr\/maziyar\/2014\/01\/29\/5-minutes-with-viral-news-on-twitter\/","url_meta":{"origin":4526,"position":2},"title":"5 Minutes with Viral News on Twitter: Golden Globes, Grammy Awards and State Of The Union 2014","author":"Maziyar","date":"January 29, 2014","format":false,"excerpt":"Our MongoDB replica set servers stats during viral tweets (GoldenGlobes, Grammys, and State Of The Union 2014) Here is some of the popular news accounts on Twitter that can be retweeted up to 1.5 thousands within 5 minutes: \u00a0 The Grammy Awards: State Of The Union 2014 (SOTU) \u00a0","rel":"","context":"In &quot;Geeky&quot;","block_context":{"text":"Geeky","link":"https:\/\/iscpif.fr\/maziyar\/category\/geeky\/"},"img":{"alt_text":"","src":"https:\/\/i0.wp.com\/iscpif.fr\/maziyar\/wp-content\/uploads\/sites\/5\/2015\/06\/GoldenGlobesAccounts.png?resize=350%2C200&ssl=1","width":350,"height":200,"srcset":"https:\/\/i0.wp.com\/iscpif.fr\/maziyar\/wp-content\/uploads\/sites\/5\/2015\/06\/GoldenGlobesAccounts.png?resize=350%2C200&ssl=1 1x, https:\/\/i0.wp.com\/iscpif.fr\/maziyar\/wp-content\/uploads\/sites\/5\/2015\/06\/GoldenGlobesAccounts.png?resize=525%2C300&ssl=1 1.5x, https:\/\/i0.wp.com\/iscpif.fr\/maziyar\/wp-content\/uploads\/sites\/5\/2015\/06\/GoldenGlobesAccounts.png?resize=700%2C400&ssl=1 2x, https:\/\/i0.wp.com\/iscpif.fr\/maziyar\/wp-content\/uploads\/sites\/5\/2015\/06\/GoldenGlobesAccounts.png?resize=1050%2C600&ssl=1 3x, https:\/\/i0.wp.com\/iscpif.fr\/maziyar\/wp-content\/uploads\/sites\/5\/2015\/06\/GoldenGlobesAccounts.png?resize=1400%2C800&ssl=1 4x"},"classes":[]},{"id":4559,"url":"https:\/\/iscpif.fr\/maziyar\/2014\/01\/13\/how-golden-globe-awards-is-about-to-break-my-real-time-twitter-app-servers-on-aws\/","url_meta":{"origin":4526,"position":3},"title":"How &#8220;Golden Globe Awards&#8221; is about to break my real-time Twitter app servers on AWS!","author":"Maziyar","date":"January 13, 2014","format":false,"excerpt":"Tweets are being retweeted more than ever when they mention who just won an award! Look at the stats from my MongoDB replica set, you'll understand the updates have a huge pick. Also global lock went from 20% to over 60%.","rel":"","context":"In &quot;Geeky&quot;","block_context":{"text":"Geeky","link":"https:\/\/iscpif.fr\/maziyar\/category\/geeky\/"},"img":{"alt_text":"","src":"https:\/\/i0.wp.com\/iscpif.fr\/maziyar\/wp-content\/uploads\/sites\/5\/2015\/06\/hour.png?resize=350%2C200&ssl=1","width":350,"height":200,"srcset":"https:\/\/i0.wp.com\/iscpif.fr\/maziyar\/wp-content\/uploads\/sites\/5\/2015\/06\/hour.png?resize=350%2C200&ssl=1 1x, https:\/\/i0.wp.com\/iscpif.fr\/maziyar\/wp-content\/uploads\/sites\/5\/2015\/06\/hour.png?resize=525%2C300&ssl=1 1.5x, https:\/\/i0.wp.com\/iscpif.fr\/maziyar\/wp-content\/uploads\/sites\/5\/2015\/06\/hour.png?resize=700%2C400&ssl=1 2x, https:\/\/i0.wp.com\/iscpif.fr\/maziyar\/wp-content\/uploads\/sites\/5\/2015\/06\/hour.png?resize=1050%2C600&ssl=1 3x, https:\/\/i0.wp.com\/iscpif.fr\/maziyar\/wp-content\/uploads\/sites\/5\/2015\/06\/hour.png?resize=1400%2C800&ssl=1 4x"},"classes":[]},{"id":4594,"url":"https:\/\/iscpif.fr\/maziyar\/2014\/03\/11\/some-of-the-stats-during-oscars-2014\/","url_meta":{"origin":4526,"position":4},"title":"Some of the stats during Oscars 2014","author":"Maziyar","date":"March 11, 2014","format":false,"excerpt":"","rel":"","context":"In &quot;Geeky&quot;","block_context":{"text":"Geeky","link":"https:\/\/iscpif.fr\/maziyar\/category\/geeky\/"},"img":{"alt_text":"","src":"https:\/\/i0.wp.com\/iscpif.fr\/maziyar\/wp-content\/uploads\/sites\/5\/2015\/06\/minutes.png?resize=350%2C200&ssl=1","width":350,"height":200,"srcset":"https:\/\/i0.wp.com\/iscpif.fr\/maziyar\/wp-content\/uploads\/sites\/5\/2015\/06\/minutes.png?resize=350%2C200&ssl=1 1x, https:\/\/i0.wp.com\/iscpif.fr\/maziyar\/wp-content\/uploads\/sites\/5\/2015\/06\/minutes.png?resize=525%2C300&ssl=1 1.5x, https:\/\/i0.wp.com\/iscpif.fr\/maziyar\/wp-content\/uploads\/sites\/5\/2015\/06\/minutes.png?resize=700%2C400&ssl=1 2x, https:\/\/i0.wp.com\/iscpif.fr\/maziyar\/wp-content\/uploads\/sites\/5\/2015\/06\/minutes.png?resize=1050%2C600&ssl=1 3x, https:\/\/i0.wp.com\/iscpif.fr\/maziyar\/wp-content\/uploads\/sites\/5\/2015\/06\/minutes.png?resize=1400%2C800&ssl=1 4x"},"classes":[]},{"id":4616,"url":"https:\/\/iscpif.fr\/maziyar\/2014\/07\/25\/building-a-real-time-news-analytics\/","url_meta":{"origin":4526,"position":5},"title":"Building a real-time news analytics","author":"Maziyar","date":"July 25, 2014","format":false,"excerpt":"It is always interesting to find out what exactly is happening around the world as they are happening. This feature of knowing something as it happens is so called \"realtime\" or \"near realtime\" because of the network latency, delay for processing the data, delay for visualizing and streaming the data,\u2026","rel":"","context":"In &quot;Geeky&quot;","block_context":{"text":"Geeky","link":"https:\/\/iscpif.fr\/maziyar\/category\/geeky\/"},"img":{"alt_text":"","src":"https:\/\/i0.wp.com\/iscpif.fr\/maziyar\/wp-content\/uploads\/sites\/5\/2015\/06\/Screenshot-2014-06-12-17.45.22.png?resize=350%2C200&ssl=1","width":350,"height":200,"srcset":"https:\/\/i0.wp.com\/iscpif.fr\/maziyar\/wp-content\/uploads\/sites\/5\/2015\/06\/Screenshot-2014-06-12-17.45.22.png?resize=350%2C200&ssl=1 1x, https:\/\/i0.wp.com\/iscpif.fr\/maziyar\/wp-content\/uploads\/sites\/5\/2015\/06\/Screenshot-2014-06-12-17.45.22.png?resize=525%2C300&ssl=1 1.5x, https:\/\/i0.wp.com\/iscpif.fr\/maziyar\/wp-content\/uploads\/sites\/5\/2015\/06\/Screenshot-2014-06-12-17.45.22.png?resize=700%2C400&ssl=1 2x, https:\/\/i0.wp.com\/iscpif.fr\/maziyar\/wp-content\/uploads\/sites\/5\/2015\/06\/Screenshot-2014-06-12-17.45.22.png?resize=1050%2C600&ssl=1 3x, https:\/\/i0.wp.com\/iscpif.fr\/maziyar\/wp-content\/uploads\/sites\/5\/2015\/06\/Screenshot-2014-06-12-17.45.22.png?resize=1400%2C800&ssl=1 4x"},"classes":[]}],"jetpack_likes_enabled":true,"_links":{"self":[{"href":"https:\/\/iscpif.fr\/maziyar\/wp-json\/wp\/v2\/posts\/4526","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/iscpif.fr\/maziyar\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/iscpif.fr\/maziyar\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/iscpif.fr\/maziyar\/wp-json\/wp\/v2\/users\/65"}],"replies":[{"embeddable":true,"href":"https:\/\/iscpif.fr\/maziyar\/wp-json\/wp\/v2\/comments?post=4526"}],"version-history":[{"count":1,"href":"https:\/\/iscpif.fr\/maziyar\/wp-json\/wp\/v2\/posts\/4526\/revisions"}],"predecessor-version":[{"id":5197,"href":"https:\/\/iscpif.fr\/maziyar\/wp-json\/wp\/v2\/posts\/4526\/revisions\/5197"}],"wp:attachment":[{"href":"https:\/\/iscpif.fr\/maziyar\/wp-json\/wp\/v2\/media?parent=4526"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/iscpif.fr\/maziyar\/wp-json\/wp\/v2\/categories?post=4526"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/iscpif.fr\/maziyar\/wp-json\/wp\/v2\/tags?post=4526"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}