الوصف الوظيفي
As a Big Data Developer on our team, you will be involved in building one of the largest Big Data systems in the world. Collaborating with Product Managers, Architects and Software Engineers to research, design and improve core big data analytics functionalities, in the area of ingestion, enrichment, search, and/or analytics.
What you’ll do:
• Be passionate in applying software engineering skills to solve real life big data analytical problems
• Write code to process billions of data records daily from heterogeneous sources.
• Deploy ETL solutions to work on clusters with hundreds of nodes, storing petabytes of data.
• Participate in all phases of the development process – analysis, design, construction, testing and implementation in agile development life cycles.
• Translate user stories into innovative solutions that provide an excellent client experience and align with Digital’s architectural roadmap.
• Maintain detailed technical designs that account for security, resiliency, scalability, maintainability, and performance.
• Strive for continuous improvements of our processes, application designs, and application execution.
• Collaborate with onshore and offshore resources, ensuring adherence to our processes and standards.
المهارات
What you’ll need to Succeed:
• Bachelor’s Degree or higher with a Minimum of 7 years of experience working on Big Data-related technologies; Master’s Degree and a minimum of 5 years of experience are preferred.
• Experience in Java and/or Scala, with OOD/OOP design skills, with proficiency in Linux environment along with knowledge of writing unit test and testable code.
• Hands on experience in building big data applications on your current job role.
• Strong experience in Spark Core, Spark Streaming. Alternatively, Flink, Storm, Apache Beam can be considered.
• Strong experience in Kafka.
• Strong experience in HBase or Cassandra.
• Strong experience working with Cloudera, Hortonworks or similar Big Data platform managers.
• Experience in ElasticSearch or Solr.
• Experience in using Spring framework.
• Experience with development and configuration tools (Git, Jira, Jenkins, etc.) and Continuous Integration practices.
• Experience in debugging issues, resolving performance issues and coordination with external teams (as needed) until successful resolution of issues.
• Proven experience working with various data formats like Columnar databases, Parquet, Avro, XML, JSON, Datasets & DataFrames concepts.
Bonus Qualifications:
• Knowledge/Experience with a cloud stack.
• Telecom and/or government data set experience/knowledge
• Desirable Spark SQL, Spark ML, and/or Spark GraphX
• Experience working in an Agile development
• Knowledge of common design patterns and pattern based development
تفاصيل الوظيفة
منطقة الوظيفة أبوظبي, الإمارات العربية المتحدة
قطاع الشركة القطاع الحكومي
طبيعة عمل الشركة شركة توظيف
الدور الوظيفي تكنولوجيا المعلومات
نوع التوظيف دوام كامل
الراتب الشهري غير محدد
عدد الوظائف الشاغرة غير محدد
المرشح المفضل
المستوى المهني متوسط الخبرة
عدد سنوات الخبرة الحد الأدنى: 4 الحد الأقصى: 7
*** تقدم على الرابط التالي : Apply on the following link ***
https://www.bayt.com/ar/uae/jobs/big-data-developer-3978416/