Job Details-
Country/Region: INDIA
State: KARNATAKA
City: Bangalore
Category: Technical Specialist
Required Education: Bachelor's Degree
Position Type: Professional
Employment Type: Full-Time
Contract Type: Regular
Company: IBM India Private Limited
Travel Required: Up to 10% or 1 day a week
Your Role and Responsibilities
As Big Data Engineer, you will develop, maintain, evaluate and test big data solutions. You will be involved in data engineering activities like Creating pipelines / workflows for Source to Target etc.
Responsibilities:
- You will be involved in the design of data solutions using Hadoop based technologies along with Hadoop, Azure, HDInsights for Cloudera based Data Late using Scala Programming.
- Responsible to Ingest data from files, streams and databases. Process the data with Hadoop, Scala, SQL Database, Spark, ML, IoT
- Develop programs in Scala and Python as part of data cleaning and processing
- Responsible to design and develop distributed, high volume, high velocity multi-threaded event processing systems
- Develop efficient software code for multiple use cases leveraging Python and Big Data technologies for various use cases built on the platform
- Provide high operational excellence guaranteeing high availability and platform stability
- Implement scalable solutions to meet the ever-increasing data volumes, using big data/cloud technologies Pyspark, Kafka, any Cloud computing etc.
If you thrive in a dynamic, collaborative workplace, IBM provides an environment where you will be challenged and inspired every single day. And if you relish the freedom to bring creative, thoughtful solutions to the table, there’s no limit to what you can accomplish here.
Required Technical and Professional Expertise
- Minimum 5+ years of experience in Big Data technologies
- Proficient in any of the programming languages – Python, Scala or Java
- Mandatory experience in Mid to Expert Level programming capabilities in a large-scale enterprise
- In-depth experience in modern data platform components such as the Hadoop, Hive, Pig, Spark, Python, Scala, etc
- Experience with Distributed Versioning Control environments such as GIT
- Familiarity with development tools – experience on either IntelliJ / Eclipse / VSCode IDE, Build Tool Maven
- Demonstrated experience in modern API platform design including how modern UI’s are built consuming services / APIs.
- Experience on Azure cloud including Data Factory, Databricks, Data Lake Storage is highly preferred
- Solid experience in all phases of Software Development Lifecycle – plan, design, develop, test, release, maintain and support, decommission
Preferred Technical and Professional Expertise
- Good to have atleast one of the Certifications listed here:
- AZ 900 – Azure Fundamentals
- DP 200, DP 201, DP 203, AZ 204 – Data Engineering
- AZ 400 – Devops Certification
- You love collaborative environments that use agile methodologies to encourage creative design thinking and find innovative ways to develop with cutting edge technologies
- Ambitious individual who can work under their own direction towards agreed targets/goals and with creative approach to work
- Intuitive individual with an ability to manage change and proven time management
- Proven interpersonal skills while contributing to team effort by accomplishing related results as needed
- Up-to-date technical knowledge by attending educational workshops, reviewing publications
At IBM, work is more than a job – it’s a calling: To build. To design. To code. To consult. To think along with clients and sell. To make markets. To invent. To collaborate. Not just to do something better, but to attempt things you’ve never thought possible. Are you ready to lead in this new era of technology and solve some of the world’s most challenging problems? If so, lets talk.
IBM’s greatest invention is the IBMer. We believe that progress is made through progressive thinking, progressive leadership, progressive policy and progressive action. IBMers believe that the application of intelligence, reason and science can improve business, society and the human condition. Restlessly reinventing since 1911, we are the largest technology and consulting employer in the world, with more than 380,000 IBMers serving clients in 170 countries.
About the Creator
When the Robots Took My Job
This is for RM Stockton's Write Club prompt for the month of April: AI Please allow me to vent. For "college," I went to a scam school that is now closed. We were promised internships that were never spoken of again after admissions, and we were promised help finding jobs. The first time I went to the career counselor's office, she was completely frazzled. She had no idea what to do with us, the film majors. The second time I visited her office, I let her know that I'd found myself a job, and she was visibly relieved.
By Rebekah Conard4 days ago in Journal
Nigerians No Longer Being Blamed For All of Ghana's Issues Black Americans Are & Another Black American Murdered in Ghana
Thursday, 25 April 2024 By: TB Obwoge I remember telling my Kenyan friend about not being able to go any where in the country for longer distances without a heavily armed Ghana police officer on the bus. He said to me, "that's so 1980's, in Kenya we no longer need that!" I laughed because having lived in Kenya it was never something I saw or experienced.
By IwriteMywrongsabout 9 hours ago in Journal
Two Pink Lines
I had never really felt like a child. I'd always had to raise myself. My mother was just a teenager when she'd had me and consequently, we had spent my whole childhood arguing and fighting like a couple of sisters as opposed to mother and daughter. My father was older than my mother but still had some maturing to do himself. He focused his entire life on me, his little girl but never realized the pressure that put on me. I always felt I had to raise him even as he was trying to raise me. We raised each other. Then, I met him. He cares, he shows me a love like I've never known. For once, it's about me and I don't have to focus on other people's needs and what someone needs from me. Someone always wants something from you. That is what my parents have taught me. Love is selfish but it isn't with him. He is perfect, beautiful, funny, and can take me to places I've only dreamed about. Places outside my mind and my own pathetic life and I know that I will always love him. When we first met, I wanted him to have my children, but now? Right now, with us both still in high school? This is all happening so soon. I slipped into the restroom at work. It had been 6 weeks since my last menstrual and this was not normal. I couldn't wait any longer. I put the top on the test and waited. These 60 seconds felt like forever. What would we do? We were both seniors so we didn't have long to go before school was over but this was not the plan. The plan was for him to join the Army and me the National Guard and for me to get my associate's degree and then we marry, then have kids.
By Lindsey Altom4 days ago in Fiction
Comments
There are no comments for this story
Be the first to respond and start the conversation.