Job Description

TITLE:Scala Spark Programmer-Bigdata Engineer Experience: 5-10Years Location: Hyderabad,Bangalore,Vizag Mandate Skills -Hadoop,HDFS,Spark&Scala,Scala Programming,Hive,Pyspark,SQL,Bigdata NP- 0-15 Days : Experience in building and optimizing data pipelines using Spark& Scala Experience with big data tools: Hadoop, Hdfs, Spark&Scala, Hive, Kafka, Yarn, Zookeeper Good understand about Scala programming Good understand about Hadoop architcture and distribued file systems Good understanding over spark internal architecture Having good amount knowledge any schedular tools (Airflow/Oozie/TWS/Autosys) Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement. Strong analytic skills related to working with structure and unstructured datasets. Build processes supporting data transformation, data structures, metadata, dependency and workload management. A successful history of manipulating, processing and extracting value from large disconnected datasets. Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases. Working knowledge of message queuing, stream processing, and highly scalable \'big data\' data stores. Strong project management and organizational skills. Experience supporting and working with cross-functional teams in a very fast dynamic environment.

foundit