India After Gandhi: 1 – Freedom and Parricade
The disappearance of the British Raj in India is at present, and must for a long time be, simply inconceivable. That it should be replaced by a native Government or Governments is the wildest of wild...
View ArticleWhat People Don’t Tell You About Redshift
Two years ago when I first read about Redshift and the claim that it was 10x faster than Hive I was blown away. Incredible! I used to evangelize Redshift to everyone in my team or outside. But using it...
View ArticleHive – Partition Column Name – CamelCase – Bad Idea
Outside Java code I prefer snake_case over camelCase. This is mostly a preference without any strong good reason: Without a proper IDE I find it easier to read snake_case words than camelCase words....
View ArticleGetting Started With Running
Every now and then I make up my mind and try to be a regular at gym. The gym in our Sriram Spandhana Apartment is well equipped and is absolutely free for all the residents. We even have (or at least...
View ArticleChelsea: Welcome Falcao
Chelsea’s biggest move in the Transfer Market ‘2015 has been getting Radamel Falcao on loan. I don’t know if I should be happy about this move or not. We have seen a lot of strikers come and fail at...
View ArticleIndia After Gandhi: 2 – The Logic of Division
It was India’s historic destiny that many human races and cultures should flow to her, finding a home in her hospitable soil, and that many a caravan should find rest here … Eleven hundred years of...
View ArticleFootball Review: Week 3-9 Aug 2015
The Week That Was Jose Mourinho has signed a new four-year contract with Chelsea pic.twitter.com/6Hf3y4EbrX — TheSPORTbible (@TSBible) August 7, 2015 The Barclays Premier League finally got underway...
View ArticleFootball Social Media Popularity – Aug 2015
With the non-matchday revenue becoming increasingly significant for the teams, the image of a particular team amongst the fans has never been this important. Football clubs are reaching out to fans by...
View ArticleFootball Review: Week 10 – 21 Aug 2015
The Week That Was A sad 2-2 start against Swansea turned into a disastrous 3-0 loss against Manchester United for Chelsea. The Chelsea gameplay was more shocking than the scoreline. Jose Mourinho was...
View ArticleJava Lambda Recipes 1 – Read Data From File Into Pojo
Today I was refactoring this piece of code which had way too many IF..Else statements. We get data from an upstream team as files in S3. Each file contains the details of a customer. Unfortunately...
View ArticleChess – The Beginnings
I watched the movie Pawn’s Sacrifice on my flight back from Seattle. It brought back memories from the time I used to play chess. Oh I was a terrible player but still liked playing. I was more of an...
View ArticleIntelliJ IDEA: Key Promoter Plugin
Most of the actions we use the mouse for can be done using the right keyboard shortcuts. But it’s hard to identify and learn the right shortcuts that could speed up your work. One nice plugin to...
View ArticleDoctor Strange: A Weird Mashup of Matrix, Inception and Iron Man
First things first – this was our first IMAX movie in the Pacific Science Center Seattle and the experience wowed me! The large screen apart, I loved the sound system. The sound seemed to surround me,...
View ArticleGo: Hello World!
While searching for courses on Scala, I landed on a website that raved about Go. So, after quickly completing the Scala course on BigDataUniversity I picked up Go. All I have done so far is install Go...
View ArticleLeetCode 126: Word Ladder
Problem: Word Ladder Difficulty: Medium Solution: 127_word_ladder.py The solution has been implemented in Python 2.7. Word Ladder is a pretty standard problem. You are given a dictionary of words, each...
View ArticleScrapy: Crawl WhoScored For Football Stats
Earlier, I have written code to crawl Google Play, iTunes AppStore and Goal.com websites. But every time I re-wrote the code to get content from website, parse it using BeautifulSoup while maintaining...
View ArticleWriting UDF To Parse JSON In Hive
Sometimes we need to perform data transformation in ways too complicated for SQL (even with the Custom UDF’s provided by hive). Let’s take JSON manipulation as an example. JSON is widely used to store...
View ArticleParse Json in Hive Using Hive JSON Serde
In an earlier post I wrote a custom UDF to read JSON into my table. Since then I have also learnt about and used the Hive-JSON-Serde. I will use the same example as before. { "customer" : {...
View ArticleWriting Into Dynamic Partitions Using Spark
Context Hive has this wonderful feature of partitioning — a way of dividing a table into related parts based on the values of certain columns. Using partitions, it’s easy to query a portion of data....
View ArticleMaking Sense | Is Life Actually Worth Living?
Sam Harris and David Benatar discuss the asymmetry between the good and bad things in life, the ethics of existential risk, the moral landscape, the limits and paradoxes of introspection, the...
View Article