{"id":5231,"date":"2015-11-28T20:59:48","date_gmt":"2015-11-28T18:59:48","guid":{"rendered":"http:\/\/iscpif.fr\/maziyar\/?p=5231"},"modified":"2015-12-10T10:20:19","modified_gmt":"2015-12-10T08:20:19","slug":"big-data-what-i-am-thankful-this-thanksgiving","status":"publish","type":"post","link":"https:\/\/iscpif.fr\/maziyar\/2015\/11\/28\/big-data-what-i-am-thankful-this-thanksgiving\/","title":{"rendered":"Big Data: What I am thankful this Thanksgiving!"},"content":{"rendered":"<h3><strong>Big Data platform at ISCPIF: This list represents what I am thankful to\u00a0this Thanksgiving<\/strong><\/h3>\n<ul>\n<li><strong>Elasticsearch<\/strong> <em>You know for search<\/em>!<\/li>\n<\/ul>\n<p>This is the heart and the soul of our discovery and curiosity. The first step of every data analytics is finding the right data. Behind every great data discovery there must be a great search engine \ud83d\ude42 And this is where Elasticsearch comes to the rescue with all its advanced real-time data analytics and powerful full-text search abilities built over Apache Lucene.<br \/>\nISCPIF Big Data platform uses Elasticsearch and its built-in distributed and high availability feature with over <strong>900 million<\/strong>\u00a0documents indexed in order to facilitate data discoveries and explorations for\u00a0our researchers and scientific partners.<\/p>\n<p>So I am thankful to Elasticsearch for the past 2 years, which made my life much easier and made me a better engineer.<br \/>\n<!--more--><\/p>\n<p>Say hello to iscpif Elasticsearch 2.1 cluster:<\/p>\n<pre><code>{\r\n  \"name\" : \"iscpif-es-4\",\r\n  \"cluster_name\" : \"iscpif-es\",\r\n  \"version\" : {\r\n    \"number\" : \"2.1.0\",    \r\n    \"build_timestamp\" : \"2015-11-18T22:40:03Z\",\r\n    \"lucene_version\" : \"5.3.1\"\r\n  },\r\n  \"tagline\" : \"You Know, for Search\"\r\n}\r\n<\/code><\/pre>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone wp-image-5236 size-medium\" src=\"http:\/\/iscpif.fr\/maziyar\/wp-content\/uploads\/sites\/5\/2015\/11\/pasted-image-16264-1024x300.png\" alt=\"iscpif Elasticsearch cluster\" width=\"1024\" height=\"300\" srcset=\"https:\/\/iscpif.fr\/maziyar\/wp-content\/uploads\/sites\/5\/2015\/11\/pasted-image-16264-1024x300.png 1024w, https:\/\/iscpif.fr\/maziyar\/wp-content\/uploads\/sites\/5\/2015\/11\/pasted-image-16264-2048x599.png 2048w\" sizes=\"auto, (max-width: 706px) 89vw, (max-width: 767px) 82vw, 740px\" \/><\/p>\n<ul>\n<ul>\n<li><strong>Kibana\u00a0<\/strong><em>Explore &amp; Visualize Your Data<\/em>!<\/li>\n<\/ul>\n<\/ul>\n<p>Man I wish I could say data means something without visualization, but I&#8217;m afraid it just doesn&#8217;t! Not much to be honest. Everyone needs an interactive dashboard of endless visualizations, charts, maps, etc. that just works right of the box. Kibana obviously plugs perfectly and easily into Elasticsearch and it just takes your data to a whole new level.<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone wp-image-5237 size-medium\" src=\"http:\/\/iscpif.fr\/maziyar\/wp-content\/uploads\/sites\/5\/2015\/11\/pasted-image-15570-1024x519.png\" alt=\"Kibana at ISCPIF\" width=\"1024\" height=\"519\" srcset=\"https:\/\/iscpif.fr\/maziyar\/wp-content\/uploads\/sites\/5\/2015\/11\/pasted-image-15570-1024x519.png 1024w, https:\/\/iscpif.fr\/maziyar\/wp-content\/uploads\/sites\/5\/2015\/11\/pasted-image-15570-2048x1039.png 2048w\" sizes=\"auto, (max-width: 706px) 89vw, (max-width: 767px) 82vw, 740px\" \/><\/p>\n<p>I am so happy\u00a0that I upgraded the entire cluster into version 2.1 so I could upgrade the\u00a0Kibana to 4.3 as well \ud83d\ude42<\/p>\n<p><a href=\"http:\/\/iscpif.fr\/maziyar\/wp-content\/uploads\/sites\/5\/2015\/11\/Screen-Shot-2015-11-28-at-18.24.12.png\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone wp-image-5239 size-medium\" src=\"http:\/\/iscpif.fr\/maziyar\/wp-content\/uploads\/sites\/5\/2015\/11\/Screen-Shot-2015-11-28-at-18.24.12-1024x313.png\" alt=\"Kibana at ISCPIF\" width=\"1024\" height=\"313\" srcset=\"https:\/\/iscpif.fr\/maziyar\/wp-content\/uploads\/sites\/5\/2015\/11\/Screen-Shot-2015-11-28-at-18.24.12-1024x313.png 1024w, https:\/\/iscpif.fr\/maziyar\/wp-content\/uploads\/sites\/5\/2015\/11\/Screen-Shot-2015-11-28-at-18.24.12-2048x625.png 2048w\" sizes=\"auto, (max-width: 706px) 89vw, (max-width: 767px) 82vw, 740px\" \/><\/a> <a href=\"http:\/\/iscpif.fr\/maziyar\/wp-content\/uploads\/sites\/5\/2015\/11\/Screen-Shot-2015-11-28-at-18.23.12.png\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone wp-image-5238 size-medium\" src=\"http:\/\/iscpif.fr\/maziyar\/wp-content\/uploads\/sites\/5\/2015\/11\/Screen-Shot-2015-11-28-at-18.23.12-1024x476.png\" alt=\"Kibana at ISCPIF\" width=\"1024\" height=\"476\" srcset=\"https:\/\/iscpif.fr\/maziyar\/wp-content\/uploads\/sites\/5\/2015\/11\/Screen-Shot-2015-11-28-at-18.23.12-1024x476.png 1024w, https:\/\/iscpif.fr\/maziyar\/wp-content\/uploads\/sites\/5\/2015\/11\/Screen-Shot-2015-11-28-at-18.23.12-2048x952.png 2048w\" sizes=\"auto, (max-width: 706px) 89vw, (max-width: 767px) 82vw, 740px\" \/><\/a><\/p>\n<ul>\n<li><strong>MongoDB\u00a0<\/strong><em>Launch your GIANT idea<\/em>!<\/li>\n<\/ul>\n<p>This has been always the backbone of every one of my architectures that I&#8217;ve ever designed and implemented. No matter what happens to the rest, I always know this preserves all my incoming data at any cost. Sure some ups and downs once in a while along the road \u00a0(some my own faults, some maybe bugs), but which\u00a0technology doesn&#8217;t have its own stuff anyway.<\/p>\n<p>At ISCPIF, we have over <strong>360K<\/strong> documents per hour and <strong>8M<\/strong> every day. Also some of our scientific computations generate over millions of records and we are thankful for new MongoDB <strong>130K<\/strong> inserts\/s and thousands of queries and aggregations per second. Without a doubt I have built such great tools in\u00a0the verity of topics\u00a0over the past\u00a03 years by the help of MongoDB. Whether it&#8217;s a Web-based application or a mobile application I know MongoDB just plays nicely with the rest of my architecture pieces and provides everything I need from a database.<\/p>\n<p>In a way MongoDB was my first NoSQL experience. Like they say, you won&#8217;t forget your first but\u00a0it made me forget all about the relational databases with all its charm and easy going nature \ud83d\ude42 I am thankful for that for sure!<\/p>\n<p>Also thankful for its pluggable storage and WiredTiger. The compression makes the life whole a lot easier. I almost save 50% of my storage just by using WiredTiger default compression. We are all proud for hitting our first <strong>3 billion<\/strong> documents by the way.<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-medium wp-image-5251\" src=\"http:\/\/iscpif.fr\/maziyar\/wp-content\/uploads\/sites\/5\/2015\/11\/Screen-Shot-2015-11-28-at-23.09.55-1024x705.png\" alt=\"MongoDB at ISCPIF\" width=\"1024\" height=\"705\" srcset=\"https:\/\/iscpif.fr\/maziyar\/wp-content\/uploads\/sites\/5\/2015\/11\/Screen-Shot-2015-11-28-at-23.09.55-1024x705.png 1024w, https:\/\/iscpif.fr\/maziyar\/wp-content\/uploads\/sites\/5\/2015\/11\/Screen-Shot-2015-11-28-at-23.09.55.png 2044w\" sizes=\"auto, (max-width: 706px) 89vw, (max-width: 767px) 82vw, 740px\" \/><\/p>\n<p>&nbsp;<\/p>\n<p>&nbsp;<\/p>\n<p>&nbsp;<\/p>\n<p>At the end this Thanksgiving, we are thankful to\u00a0the entire<strong>\u00a0Open Source<\/strong> community and all its <strong>contributors<\/strong> who work hard days and nights to build such great tools.<\/p>\n<blockquote><p>Open Source is not just free, it&#8217;s just amazing!<\/p><\/blockquote>\n<p><em>This list will be\u00a0updated<\/em>\u00a0soon with MongoDB, NodeJS, Redis, RabbitMQ, etc. \ud83d\ude09<\/p>\n<p><a href=\"https:\/\/www.elastic.co\/products\/elasticsearch\" target=\"_blank\">https:\/\/www.elastic.co\/products\/elasticsearch<\/a><\/p>\n<p><a href=\"https:\/\/www.elastic.co\/products\/kibana\" target=\"_blank\">https:\/\/www.elastic.co\/products\/kibana<\/a><\/p>\n<p><a href=\"https:\/\/www.mongodb.org\/\" target=\"_blank\">https:\/\/www.mongodb.org\/<\/a><\/p>\n<p><a href=\"http:\/\/redis.io\/\" target=\"_blank\">http:\/\/redis.io\/<\/a><\/p>\n<p><a href=\"https:\/\/www.rabbitmq.com\/\" target=\"_blank\">https:\/\/www.rabbitmq.com\/<\/a><\/p>\n<p><a href=\"https:\/\/nodejs.org\/en\/\" target=\"_blank\">https:\/\/nodejs.org\/en\/<\/a><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Big Data platform at ISCPIF: This list represents what I am thankful to\u00a0this Thanksgiving Elasticsearch You know for search! This is the heart and the soul of our discovery and curiosity. The first step of every data analytics is finding the right data. Behind every great data discovery there must be a great search engine &hellip; <\/p>\n<p class=\"link-more\"><a href=\"https:\/\/iscpif.fr\/maziyar\/2015\/11\/28\/big-data-what-i-am-thankful-this-thanksgiving\/\" class=\"more-link\">Continue reading<span class=\"screen-reader-text\"> &#8220;Big Data: What I am thankful this Thanksgiving!&#8221;<\/span><\/a><\/p>\n","protected":false},"author":65,"featured_media":5234,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_jetpack_newsletter_access":"","_jetpack_dont_email_post_to_subs":false,"_jetpack_newsletter_tier_id":0,"_jetpack_memberships_contains_paywalled_content":false,"_jetpack_feature_clip_id":0,"_jetpack_memberships_contains_paid_content":false,"footnotes":"","jetpack_publicize_message":"","jetpack_publicize_feature_enabled":true,"jetpack_social_post_already_shared":true,"jetpack_social_options":{"image_generator_settings":{"template":"highway","default_image_id":0,"font":"","enabled":false},"version":2},"jetpack_post_was_ever_published":false},"categories":[49,10],"tags":[14,19,23,30,36,38,41,42,44],"class_list":["post-5231","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-iscpif","category-techstuff","tag-bigdata","tag-elasticsearch","tag-featured","tag-kibana","tag-mongodb","tag-node-js","tag-rabbitmq","tag-redis","tag-socketio"],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v27.8 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>Big Data: What I am thankful this Thanksgiving! - Maziyar PANAHI<\/title>\n<meta name=\"description\" content=\"This list represents what I am thankful\u00a0to\u00a0this Thanksgiving since I&#039;ve started designing and implementing Big Data platform at ISCPIF\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/iscpif.fr\/maziyar\/2015\/11\/28\/big-data-what-i-am-thankful-this-thanksgiving\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Big Data: What I am thankful this Thanksgiving! - Maziyar PANAHI\" \/>\n<meta property=\"og:description\" content=\"This list represents what I am thankful\u00a0to\u00a0this Thanksgiving since I&#039;ve started designing and implementing Big Data platform at ISCPIF\" \/>\n<meta property=\"og:url\" content=\"https:\/\/iscpif.fr\/maziyar\/2015\/11\/28\/big-data-what-i-am-thankful-this-thanksgiving\/\" \/>\n<meta property=\"og:site_name\" content=\"Maziyar PANAHI\" \/>\n<meta property=\"article:published_time\" content=\"2015-11-28T18:59:48+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2015-12-10T08:20:19+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/iscpif.fr\/maziyar\/wp-content\/uploads\/sites\/5\/2015\/11\/header.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"1900\" \/>\n\t<meta property=\"og:image:height\" content=\"1267\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"author\" content=\"Maziyar\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Maziyar\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"3 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\\\/\\\/iscpif.fr\\\/maziyar\\\/2015\\\/11\\\/28\\\/big-data-what-i-am-thankful-this-thanksgiving\\\/#article\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/iscpif.fr\\\/maziyar\\\/2015\\\/11\\\/28\\\/big-data-what-i-am-thankful-this-thanksgiving\\\/\"},\"author\":{\"name\":\"Maziyar\",\"@id\":\"https:\\\/\\\/iscpif.fr\\\/maziyar\\\/#\\\/schema\\\/person\\\/02ae0118261368c80d32bef0b75f5faf\"},\"headline\":\"Big Data: What I am thankful this Thanksgiving!\",\"datePublished\":\"2015-11-28T18:59:48+00:00\",\"dateModified\":\"2015-12-10T08:20:19+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\\\/\\\/iscpif.fr\\\/maziyar\\\/2015\\\/11\\\/28\\\/big-data-what-i-am-thankful-this-thanksgiving\\\/\"},\"wordCount\":565,\"commentCount\":1,\"image\":{\"@id\":\"https:\\\/\\\/iscpif.fr\\\/maziyar\\\/2015\\\/11\\\/28\\\/big-data-what-i-am-thankful-this-thanksgiving\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/iscpif.fr\\\/maziyar\\\/wp-content\\\/uploads\\\/sites\\\/5\\\/2015\\\/11\\\/header.jpg\",\"keywords\":[\"BigData\",\"ElasticSearch\",\"featured\",\"Kibana\",\"MongoDB\",\"Node.js\",\"rabbitmq\",\"Redis\",\"Socketio\"],\"articleSection\":[\"iscpif\",\"Tech Stuff\"],\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\\\/\\\/iscpif.fr\\\/maziyar\\\/2015\\\/11\\\/28\\\/big-data-what-i-am-thankful-this-thanksgiving\\\/#respond\"]}]},{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/iscpif.fr\\\/maziyar\\\/2015\\\/11\\\/28\\\/big-data-what-i-am-thankful-this-thanksgiving\\\/\",\"url\":\"https:\\\/\\\/iscpif.fr\\\/maziyar\\\/2015\\\/11\\\/28\\\/big-data-what-i-am-thankful-this-thanksgiving\\\/\",\"name\":\"Big Data: What I am thankful this Thanksgiving! - Maziyar PANAHI\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/iscpif.fr\\\/maziyar\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/iscpif.fr\\\/maziyar\\\/2015\\\/11\\\/28\\\/big-data-what-i-am-thankful-this-thanksgiving\\\/#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/iscpif.fr\\\/maziyar\\\/2015\\\/11\\\/28\\\/big-data-what-i-am-thankful-this-thanksgiving\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/iscpif.fr\\\/maziyar\\\/wp-content\\\/uploads\\\/sites\\\/5\\\/2015\\\/11\\\/header.jpg\",\"datePublished\":\"2015-11-28T18:59:48+00:00\",\"dateModified\":\"2015-12-10T08:20:19+00:00\",\"author\":{\"@id\":\"https:\\\/\\\/iscpif.fr\\\/maziyar\\\/#\\\/schema\\\/person\\\/02ae0118261368c80d32bef0b75f5faf\"},\"description\":\"This list represents what I am thankful\u00a0to\u00a0this Thanksgiving since I've started designing and implementing Big Data platform at ISCPIF\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/iscpif.fr\\\/maziyar\\\/2015\\\/11\\\/28\\\/big-data-what-i-am-thankful-this-thanksgiving\\\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/iscpif.fr\\\/maziyar\\\/2015\\\/11\\\/28\\\/big-data-what-i-am-thankful-this-thanksgiving\\\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/iscpif.fr\\\/maziyar\\\/2015\\\/11\\\/28\\\/big-data-what-i-am-thankful-this-thanksgiving\\\/#primaryimage\",\"url\":\"https:\\\/\\\/iscpif.fr\\\/maziyar\\\/wp-content\\\/uploads\\\/sites\\\/5\\\/2015\\\/11\\\/header.jpg\",\"contentUrl\":\"https:\\\/\\\/iscpif.fr\\\/maziyar\\\/wp-content\\\/uploads\\\/sites\\\/5\\\/2015\\\/11\\\/header.jpg\",\"width\":1900,\"height\":1267,\"caption\":\"big data at iscpif\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/iscpif.fr\\\/maziyar\\\/2015\\\/11\\\/28\\\/big-data-what-i-am-thankful-this-thanksgiving\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/iscpif.fr\\\/maziyar\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Big Data: What I am thankful this Thanksgiving!\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/iscpif.fr\\\/maziyar\\\/#website\",\"url\":\"https:\\\/\\\/iscpif.fr\\\/maziyar\\\/\",\"name\":\"Maziyar PANAHI\",\"description\":\"Generative AI Leader in Healthcare\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/iscpif.fr\\\/maziyar\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\\\/\\\/iscpif.fr\\\/maziyar\\\/#\\\/schema\\\/person\\\/02ae0118261368c80d32bef0b75f5faf\",\"name\":\"Maziyar\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/286798afc2f09c77b0ab1a0a60150f989d903d23d84c3eedfb8ebd1da500e5b1?s=96&d=mm&r=g\",\"url\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/286798afc2f09c77b0ab1a0a60150f989d903d23d84c3eedfb8ebd1da500e5b1?s=96&d=mm&r=g\",\"contentUrl\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/286798afc2f09c77b0ab1a0a60150f989d903d23d84c3eedfb8ebd1da500e5b1?s=96&d=mm&r=g\",\"caption\":\"Maziyar\"},\"description\":\"Big Data engineer\",\"sameAs\":[\"https:\\\/\\\/multivac.iscpif.fr\"],\"url\":\"https:\\\/\\\/iscpif.fr\\\/maziyar\\\/author\\\/maziyar-panahi\\\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Big Data: What I am thankful this Thanksgiving! - Maziyar PANAHI","description":"This list represents what I am thankful\u00a0to\u00a0this Thanksgiving since I've started designing and implementing Big Data platform at ISCPIF","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/iscpif.fr\/maziyar\/2015\/11\/28\/big-data-what-i-am-thankful-this-thanksgiving\/","og_locale":"en_US","og_type":"article","og_title":"Big Data: What I am thankful this Thanksgiving! - Maziyar PANAHI","og_description":"This list represents what I am thankful\u00a0to\u00a0this Thanksgiving since I've started designing and implementing Big Data platform at ISCPIF","og_url":"https:\/\/iscpif.fr\/maziyar\/2015\/11\/28\/big-data-what-i-am-thankful-this-thanksgiving\/","og_site_name":"Maziyar PANAHI","article_published_time":"2015-11-28T18:59:48+00:00","article_modified_time":"2015-12-10T08:20:19+00:00","og_image":[{"width":1900,"height":1267,"url":"https:\/\/iscpif.fr\/maziyar\/wp-content\/uploads\/sites\/5\/2015\/11\/header.jpg","type":"image\/jpeg"}],"author":"Maziyar","twitter_card":"summary_large_image","twitter_misc":{"Written by":"Maziyar","Est. reading time":"3 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/iscpif.fr\/maziyar\/2015\/11\/28\/big-data-what-i-am-thankful-this-thanksgiving\/#article","isPartOf":{"@id":"https:\/\/iscpif.fr\/maziyar\/2015\/11\/28\/big-data-what-i-am-thankful-this-thanksgiving\/"},"author":{"name":"Maziyar","@id":"https:\/\/iscpif.fr\/maziyar\/#\/schema\/person\/02ae0118261368c80d32bef0b75f5faf"},"headline":"Big Data: What I am thankful this Thanksgiving!","datePublished":"2015-11-28T18:59:48+00:00","dateModified":"2015-12-10T08:20:19+00:00","mainEntityOfPage":{"@id":"https:\/\/iscpif.fr\/maziyar\/2015\/11\/28\/big-data-what-i-am-thankful-this-thanksgiving\/"},"wordCount":565,"commentCount":1,"image":{"@id":"https:\/\/iscpif.fr\/maziyar\/2015\/11\/28\/big-data-what-i-am-thankful-this-thanksgiving\/#primaryimage"},"thumbnailUrl":"https:\/\/iscpif.fr\/maziyar\/wp-content\/uploads\/sites\/5\/2015\/11\/header.jpg","keywords":["BigData","ElasticSearch","featured","Kibana","MongoDB","Node.js","rabbitmq","Redis","Socketio"],"articleSection":["iscpif","Tech Stuff"],"inLanguage":"en-US","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/iscpif.fr\/maziyar\/2015\/11\/28\/big-data-what-i-am-thankful-this-thanksgiving\/#respond"]}]},{"@type":"WebPage","@id":"https:\/\/iscpif.fr\/maziyar\/2015\/11\/28\/big-data-what-i-am-thankful-this-thanksgiving\/","url":"https:\/\/iscpif.fr\/maziyar\/2015\/11\/28\/big-data-what-i-am-thankful-this-thanksgiving\/","name":"Big Data: What I am thankful this Thanksgiving! - Maziyar PANAHI","isPartOf":{"@id":"https:\/\/iscpif.fr\/maziyar\/#website"},"primaryImageOfPage":{"@id":"https:\/\/iscpif.fr\/maziyar\/2015\/11\/28\/big-data-what-i-am-thankful-this-thanksgiving\/#primaryimage"},"image":{"@id":"https:\/\/iscpif.fr\/maziyar\/2015\/11\/28\/big-data-what-i-am-thankful-this-thanksgiving\/#primaryimage"},"thumbnailUrl":"https:\/\/iscpif.fr\/maziyar\/wp-content\/uploads\/sites\/5\/2015\/11\/header.jpg","datePublished":"2015-11-28T18:59:48+00:00","dateModified":"2015-12-10T08:20:19+00:00","author":{"@id":"https:\/\/iscpif.fr\/maziyar\/#\/schema\/person\/02ae0118261368c80d32bef0b75f5faf"},"description":"This list represents what I am thankful\u00a0to\u00a0this Thanksgiving since I've started designing and implementing Big Data platform at ISCPIF","breadcrumb":{"@id":"https:\/\/iscpif.fr\/maziyar\/2015\/11\/28\/big-data-what-i-am-thankful-this-thanksgiving\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/iscpif.fr\/maziyar\/2015\/11\/28\/big-data-what-i-am-thankful-this-thanksgiving\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/iscpif.fr\/maziyar\/2015\/11\/28\/big-data-what-i-am-thankful-this-thanksgiving\/#primaryimage","url":"https:\/\/iscpif.fr\/maziyar\/wp-content\/uploads\/sites\/5\/2015\/11\/header.jpg","contentUrl":"https:\/\/iscpif.fr\/maziyar\/wp-content\/uploads\/sites\/5\/2015\/11\/header.jpg","width":1900,"height":1267,"caption":"big data at iscpif"},{"@type":"BreadcrumbList","@id":"https:\/\/iscpif.fr\/maziyar\/2015\/11\/28\/big-data-what-i-am-thankful-this-thanksgiving\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/iscpif.fr\/maziyar\/"},{"@type":"ListItem","position":2,"name":"Big Data: What I am thankful this Thanksgiving!"}]},{"@type":"WebSite","@id":"https:\/\/iscpif.fr\/maziyar\/#website","url":"https:\/\/iscpif.fr\/maziyar\/","name":"Maziyar PANAHI","description":"Generative AI Leader in Healthcare","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/iscpif.fr\/maziyar\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/iscpif.fr\/maziyar\/#\/schema\/person\/02ae0118261368c80d32bef0b75f5faf","name":"Maziyar","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/secure.gravatar.com\/avatar\/286798afc2f09c77b0ab1a0a60150f989d903d23d84c3eedfb8ebd1da500e5b1?s=96&d=mm&r=g","url":"https:\/\/secure.gravatar.com\/avatar\/286798afc2f09c77b0ab1a0a60150f989d903d23d84c3eedfb8ebd1da500e5b1?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/286798afc2f09c77b0ab1a0a60150f989d903d23d84c3eedfb8ebd1da500e5b1?s=96&d=mm&r=g","caption":"Maziyar"},"description":"Big Data engineer","sameAs":["https:\/\/multivac.iscpif.fr"],"url":"https:\/\/iscpif.fr\/maziyar\/author\/maziyar-panahi\/"}]}},"jetpack_publicize_connections":[],"jetpack_featured_media_url":"https:\/\/iscpif.fr\/maziyar\/wp-content\/uploads\/sites\/5\/2015\/11\/header.jpg","jetpack_sharing_enabled":true,"jetpack_shortlink":"https:\/\/wp.me\/p6jMg3-1mn","jetpack-related-posts":[{"id":5278,"url":"https:\/\/iscpif.fr\/maziyar\/2015\/12\/03\/big-data-how-to-scale-from-zero-to-billions\/","url_meta":{"origin":5231,"position":0},"title":"Big Data: HOW TO SCALE FROM ZERO TO BILLIONS!","author":"Maziyar","date":"December 3, 2015","format":false,"excerpt":"How Big Data platform scaled from zero to billions of data within 6 months at ISCPIF (CNRS). This talk contains our use of Elasticsearch, MongoDB, Redis, RabbitMQ and scalable\/high available Web services built over Big Data architecture. This presentation was presented at Universit\u00e9 Paris-Sud, LAL, B\u00e2timent 200 organized by ARGOS.\u2026","rel":"","context":"In &quot;iscpif&quot;","block_context":{"text":"iscpif","link":"https:\/\/iscpif.fr\/maziyar\/category\/iscpif\/"},"img":{"alt_text":"real-time data analytics","src":"https:\/\/i0.wp.com\/iscpif.fr\/maziyar\/wp-content\/uploads\/sites\/5\/2015\/12\/Screen-Shot-2015-12-03-at-12.23.21.png?resize=350%2C200&ssl=1","width":350,"height":200,"srcset":"https:\/\/i0.wp.com\/iscpif.fr\/maziyar\/wp-content\/uploads\/sites\/5\/2015\/12\/Screen-Shot-2015-12-03-at-12.23.21.png?resize=350%2C200&ssl=1 1x, https:\/\/i0.wp.com\/iscpif.fr\/maziyar\/wp-content\/uploads\/sites\/5\/2015\/12\/Screen-Shot-2015-12-03-at-12.23.21.png?resize=525%2C300&ssl=1 1.5x, https:\/\/i0.wp.com\/iscpif.fr\/maziyar\/wp-content\/uploads\/sites\/5\/2015\/12\/Screen-Shot-2015-12-03-at-12.23.21.png?resize=700%2C400&ssl=1 2x, https:\/\/i0.wp.com\/iscpif.fr\/maziyar\/wp-content\/uploads\/sites\/5\/2015\/12\/Screen-Shot-2015-12-03-at-12.23.21.png?resize=1050%2C600&ssl=1 3x, https:\/\/i0.wp.com\/iscpif.fr\/maziyar\/wp-content\/uploads\/sites\/5\/2015\/12\/Screen-Shot-2015-12-03-at-12.23.21.png?resize=1400%2C800&ssl=1 4x"},"classes":[]},{"id":5154,"url":"https:\/\/iscpif.fr\/maziyar\/2015\/07\/01\/indexing-200m-tweets-into-our-search-engine\/","url_meta":{"origin":5231,"position":1},"title":"Indexing 200m tweets into our search engine cluster","author":"Maziyar","date":"July 1, 2015","format":false,"excerpt":"Indexing 200m tweets into our search engine cluster from Maziyar on Vimeo.","rel":"","context":"In &quot;Geeky&quot;","block_context":{"text":"Geeky","link":"https:\/\/iscpif.fr\/maziyar\/category\/geeky\/"},"img":{"alt_text":"","src":"https:\/\/i0.wp.com\/iscpif.fr\/maziyar\/wp-content\/uploads\/sites\/5\/2015\/07\/Processes.png?resize=350%2C200&ssl=1","width":350,"height":200,"srcset":"https:\/\/i0.wp.com\/iscpif.fr\/maziyar\/wp-content\/uploads\/sites\/5\/2015\/07\/Processes.png?resize=350%2C200&ssl=1 1x, https:\/\/i0.wp.com\/iscpif.fr\/maziyar\/wp-content\/uploads\/sites\/5\/2015\/07\/Processes.png?resize=525%2C300&ssl=1 1.5x, https:\/\/i0.wp.com\/iscpif.fr\/maziyar\/wp-content\/uploads\/sites\/5\/2015\/07\/Processes.png?resize=700%2C400&ssl=1 2x, https:\/\/i0.wp.com\/iscpif.fr\/maziyar\/wp-content\/uploads\/sites\/5\/2015\/07\/Processes.png?resize=1050%2C600&ssl=1 3x, https:\/\/i0.wp.com\/iscpif.fr\/maziyar\/wp-content\/uploads\/sites\/5\/2015\/07\/Processes.png?resize=1400%2C800&ssl=1 4x"},"classes":[]},{"id":4582,"url":"https:\/\/iscpif.fr\/maziyar\/2014\/02\/17\/building-search-engine-by-elasticsearch\/","url_meta":{"origin":5231,"position":2},"title":"Building Search Engine by ElasticSearch","author":"Maziyar","date":"February 17, 2014","format":false,"excerpt":"I've started to work with ElasticSearch for a while now. I gotta say it's a powerful open source for building distributed real-time search engines and analytics engines. It also uses Shards and Replica in distributed machines to make your architecture reliable and scalable. It's not just a simple full-text search\u2026","rel":"","context":"In &quot;Geeky&quot;","block_context":{"text":"Geeky","link":"https:\/\/iscpif.fr\/maziyar\/category\/geeky\/"},"img":{"alt_text":"","src":"https:\/\/i0.wp.com\/iscpif.fr\/maziyar\/wp-content\/uploads\/sites\/5\/2015\/06\/Marvel.png?resize=350%2C200&ssl=1","width":350,"height":200,"srcset":"https:\/\/i0.wp.com\/iscpif.fr\/maziyar\/wp-content\/uploads\/sites\/5\/2015\/06\/Marvel.png?resize=350%2C200&ssl=1 1x, https:\/\/i0.wp.com\/iscpif.fr\/maziyar\/wp-content\/uploads\/sites\/5\/2015\/06\/Marvel.png?resize=525%2C300&ssl=1 1.5x, https:\/\/i0.wp.com\/iscpif.fr\/maziyar\/wp-content\/uploads\/sites\/5\/2015\/06\/Marvel.png?resize=700%2C400&ssl=1 2x, https:\/\/i0.wp.com\/iscpif.fr\/maziyar\/wp-content\/uploads\/sites\/5\/2015\/06\/Marvel.png?resize=1050%2C600&ssl=1 3x, https:\/\/i0.wp.com\/iscpif.fr\/maziyar\/wp-content\/uploads\/sites\/5\/2015\/06\/Marvel.png?resize=1400%2C800&ssl=1 4x"},"classes":[]},{"id":4693,"url":"https:\/\/iscpif.fr\/maziyar\/2015\/05\/29\/lets-build-this-thing\/","url_meta":{"origin":5231,"position":3},"title":"Let&#8217;s build this thing!","author":"Maziyar","date":"May 29, 2015","format":false,"excerpt":"","rel":"","context":"In &quot;Daily&quot;","block_context":{"text":"Daily","link":"https:\/\/iscpif.fr\/maziyar\/category\/daily\/"},"img":{"alt_text":"IMG_0498","src":"https:\/\/i0.wp.com\/iscpif.fr\/maziyar\/wp-content\/uploads\/sites\/5\/2015\/06\/IMG_0498-640x640.jpg?resize=350%2C200","width":350,"height":200,"srcset":"https:\/\/i0.wp.com\/iscpif.fr\/maziyar\/wp-content\/uploads\/sites\/5\/2015\/06\/IMG_0498-640x640.jpg?resize=350%2C200 1x, https:\/\/i0.wp.com\/iscpif.fr\/maziyar\/wp-content\/uploads\/sites\/5\/2015\/06\/IMG_0498-640x640.jpg?resize=525%2C300 1.5x"},"classes":[]},{"id":4594,"url":"https:\/\/iscpif.fr\/maziyar\/2014\/03\/11\/some-of-the-stats-during-oscars-2014\/","url_meta":{"origin":5231,"position":4},"title":"Some of the stats during Oscars 2014","author":"Maziyar","date":"March 11, 2014","format":false,"excerpt":"","rel":"","context":"In &quot;Geeky&quot;","block_context":{"text":"Geeky","link":"https:\/\/iscpif.fr\/maziyar\/category\/geeky\/"},"img":{"alt_text":"","src":"https:\/\/i0.wp.com\/iscpif.fr\/maziyar\/wp-content\/uploads\/sites\/5\/2015\/06\/minutes.png?resize=350%2C200&ssl=1","width":350,"height":200,"srcset":"https:\/\/i0.wp.com\/iscpif.fr\/maziyar\/wp-content\/uploads\/sites\/5\/2015\/06\/minutes.png?resize=350%2C200&ssl=1 1x, https:\/\/i0.wp.com\/iscpif.fr\/maziyar\/wp-content\/uploads\/sites\/5\/2015\/06\/minutes.png?resize=525%2C300&ssl=1 1.5x, https:\/\/i0.wp.com\/iscpif.fr\/maziyar\/wp-content\/uploads\/sites\/5\/2015\/06\/minutes.png?resize=700%2C400&ssl=1 2x, https:\/\/i0.wp.com\/iscpif.fr\/maziyar\/wp-content\/uploads\/sites\/5\/2015\/06\/minutes.png?resize=1050%2C600&ssl=1 3x, https:\/\/i0.wp.com\/iscpif.fr\/maziyar\/wp-content\/uploads\/sites\/5\/2015\/06\/minutes.png?resize=1400%2C800&ssl=1 4x"},"classes":[]},{"id":4616,"url":"https:\/\/iscpif.fr\/maziyar\/2014\/07\/25\/building-a-real-time-news-analytics\/","url_meta":{"origin":5231,"position":5},"title":"Building a real-time news analytics","author":"Maziyar","date":"July 25, 2014","format":false,"excerpt":"It is always interesting to find out what exactly is happening around the world as they are happening. This feature of knowing something as it happens is so called \"realtime\" or \"near realtime\" because of the network latency, delay for processing the data, delay for visualizing and streaming the data,\u2026","rel":"","context":"In &quot;Geeky&quot;","block_context":{"text":"Geeky","link":"https:\/\/iscpif.fr\/maziyar\/category\/geeky\/"},"img":{"alt_text":"","src":"https:\/\/i0.wp.com\/iscpif.fr\/maziyar\/wp-content\/uploads\/sites\/5\/2015\/06\/Screenshot-2014-06-12-17.45.22.png?resize=350%2C200&ssl=1","width":350,"height":200,"srcset":"https:\/\/i0.wp.com\/iscpif.fr\/maziyar\/wp-content\/uploads\/sites\/5\/2015\/06\/Screenshot-2014-06-12-17.45.22.png?resize=350%2C200&ssl=1 1x, https:\/\/i0.wp.com\/iscpif.fr\/maziyar\/wp-content\/uploads\/sites\/5\/2015\/06\/Screenshot-2014-06-12-17.45.22.png?resize=525%2C300&ssl=1 1.5x, https:\/\/i0.wp.com\/iscpif.fr\/maziyar\/wp-content\/uploads\/sites\/5\/2015\/06\/Screenshot-2014-06-12-17.45.22.png?resize=700%2C400&ssl=1 2x, https:\/\/i0.wp.com\/iscpif.fr\/maziyar\/wp-content\/uploads\/sites\/5\/2015\/06\/Screenshot-2014-06-12-17.45.22.png?resize=1050%2C600&ssl=1 3x, https:\/\/i0.wp.com\/iscpif.fr\/maziyar\/wp-content\/uploads\/sites\/5\/2015\/06\/Screenshot-2014-06-12-17.45.22.png?resize=1400%2C800&ssl=1 4x"},"classes":[]}],"jetpack_likes_enabled":true,"_links":{"self":[{"href":"https:\/\/iscpif.fr\/maziyar\/wp-json\/wp\/v2\/posts\/5231","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/iscpif.fr\/maziyar\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/iscpif.fr\/maziyar\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/iscpif.fr\/maziyar\/wp-json\/wp\/v2\/users\/65"}],"replies":[{"embeddable":true,"href":"https:\/\/iscpif.fr\/maziyar\/wp-json\/wp\/v2\/comments?post=5231"}],"version-history":[{"count":38,"href":"https:\/\/iscpif.fr\/maziyar\/wp-json\/wp\/v2\/posts\/5231\/revisions"}],"predecessor-version":[{"id":5250,"href":"https:\/\/iscpif.fr\/maziyar\/wp-json\/wp\/v2\/posts\/5231\/revisions\/5250"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/iscpif.fr\/maziyar\/wp-json\/wp\/v2\/media\/5234"}],"wp:attachment":[{"href":"https:\/\/iscpif.fr\/maziyar\/wp-json\/wp\/v2\/media?parent=5231"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/iscpif.fr\/maziyar\/wp-json\/wp\/v2\/categories?post=5231"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/iscpif.fr\/maziyar\/wp-json\/wp\/v2\/tags?post=5231"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}