My Tweets
Tweets by pristinecrap-
Recent Posts
Archives
- January 2023 (1)
- January 2022 (3)
- October 2018 (9)
- September 2014 (1)
- August 2014 (1)
- July 2014 (2)
- June 2014 (3)
- May 2014 (1)
- April 2014 (2)
- January 2014 (1)
- December 2013 (1)
- August 2013 (1)
- July 2013 (1)
- May 2013 (2)
- February 2013 (3)
- January 2013 (7)
- December 2012 (1)
- June 2012 (1)
- August 2011 (1)
- August 2009 (1)
- July 2009 (1)
- February 2009 (2)
- November 2008 (1)
- September 2008 (2)
- August 2008 (1)
- July 2008 (3)
- June 2008 (2)
- May 2008 (6)
- April 2008 (1)
- December 2007 (1)
- July 2007 (1)
Categories
- Personal (6)
- Technical (23)
- Uncategorized (35)
Meta
Category Archives: Technical
DynamoDB: An Inside Look Into NoSQL – Part 7
In Part 6, we discussed handling failures via Hinted Handoff & Replica Synchronization. We also talked about the advantages of using a Sloppy Quorum and Merkle Trees. In this last & final part of the series, we will look into … Continue reading
Posted in Technical
Tagged aws, dynamodb internals, failure detection, gossip-based protocol, ring membership
Leave a comment
DynamoDB: An Inside Look Into NoSQL – Part 6
In Part 5, we spoke about data versioning, the 2 reconciliation strategies and how vector clocks are used for the same. In this article, we will talk about Handling Failures. Handling Failures – Hinted Handoff Even under the simplest of … Continue reading
Posted in Technical
Tagged dynamodb, dynamodb internals, handling failures, hinted handoff, merkle tree, replica sync, sloppy quorum
Leave a comment
DynamoDB: An Inside Look Into NoSQL – Part 5
In Part 4, we talked about partitioning and replication in detail. We introduced consistent hashing, virtual nodes and the concept of coordinator nodes and preference list. In this article, we will discuss Data Versioning. Data Versioning Eventual consistency, introduced by … Continue reading
Posted in Technical
Tagged data versioning, semantic reconciliation, syntactic reconciliation, vector clocks
Leave a comment
DynamoDB: An Inside Look Into NoSQL – Part 4
In Part 3, we mentioned the various distributed techniques used while architecting NoSQL data stores. A table nicely summarized these techniques and their advantages. In this article, we will go into the details of partitioning and replication. Partitioning As mentioned … Continue reading
DynamoDB: An Inside Look Into NoSQL – Part 3
In Part 2, we looked at Design Considerations of NoSQL and introduced the concept of eventual consistency. In this article, we will introduce the concepts and techniques used while architecting a NoSQL system. The core distributed systems techniques employed in … Continue reading
Posted in Technical
Tagged failure handling, membership, partioning, replication, scaling, versioning
Leave a comment
DynamoDB: An Inside Look Into NoSQL – Part 2
In Part 1, we introduced you to NoSQL, spoke about the CAP theorem and certain assumptions that need to be made while designing NoSQL data stores. Let’s dive deeper! Design Considerations Traditional commercial systems and applications perform data replication in … Continue reading
DynamoDB: An Inside Look Into NoSQL – Part 1
In our earlier posts (here and here), we introduced the Hadoop ecosystem & explained its various components using a real world example of the retail industry. We now possess a fair idea of the advantages of Big Data. NoSQL datastores … Continue reading
Hazelcast & Distributed Sequence Counter
There always comes a time in your professional career when you get stuck, and for days at a time! Every developer worth his salt has definitely gone through this phase. Another such moment occurred in my career too recently. We … Continue reading
Posted in Technical
Tagged distributed primitives, dynamodb, hazelcast, IAtomicLong, ILock, in memory data grid, Twitter Snowflake
2 Comments
Big Data for Retail Analysis – Hive & Flume
Last week we introduced Big Data ecosystem and showed a glimpse of the possibilities. This week we take one industry (Retail) use case and illustrate how the various tools can be orchestrated to provide insights. Background The last couple of … Continue reading
Big Data: Getting Started with Hadoop, Sqoop & Hive
We live in the Data Age! Web has been growing rapidly in size as well as scale during the last 10 years and shows no signs of slowing down. Statistics show that every passing year more data gets generated than all … Continue reading
pristinecrap.com 