Code Code Code Blog

Introduction We have decided to aggregate in a single post the most important things to know about hadoop in a concise way. Let’s us know if you have any comments! Hadoop ########## ## HDFS ## ########## NameNode # => Managing filesystem namespace, if you loose it you have no pointers to your data, you practially lost your data. DataNode # => You know it holds data, installed on each worker. Block # => Each file split to B1,B2,.. where each block size 128MB replication is on blocks. Name node knows that File X is split to B1,B2 and where. ########## ## YARN ## ########## ResourceManager # => Like `NameNode` for computing, tracks NodeManagers and how available they are for work. NodeManager # => Like `Datanode` for computing, offer computational resources run applications tasks in containers. ApplicationMaster # => Each application has `ApplicationMaster` process which negotiates resources with `ResourceManager` which delivers a `containe...

Introduction I was talking yesterday to a friend of mine and he is looking for a new job.  I stressed out to him that looking for a new job in high tech industry should be highly treated as series s**t business.  It involves making a plan, reviewing computer science academy basic algorithms, fine tuning your resume, and practicing logical questions and programming questions. Now although this is a serious game, we at, developers at rest , think that developers should rest, therefore an inherent part of our plan, is not to work your brain out and to take the time also to rest. This series will go through these steps, you can actually take it to be your plan, we are going to have a timeline, so that we are going to mention how much time you need to invest every day and in what. Usually web sites that focus on hacking programming tend to focus on one or only a few aspects of that area, we are going to get a holistic picture of the process, and when we feel it's time to ...