Understanding Databricks Architecture on AWS: A Basic Guide

As a Senior Software Engineer who has led the deployment of Databricks across multiple workspaces at Nike, I’ve gained deep insights into how Databricks operates on AWS. In this post, I’ll break down the architecture, share key learnings, and provide best practices for enterprise deployments. Note: This post is focused on “Classic” Databricks that deploys into your AWS account. Databricks has launched Serverless offerings, which we will look into in a follow-up post. ...

January 30, 2025 · 5 min · Manoj Mallela

Much Ado About Nothing – Scala Edition

Scala is a flexible language and it is heavily utilized by various frameworks such as Apache Spark, Apache Kafka. It is interoperable with Java and relies heavily on JVM, for now. The creator of Scala, Martin Odersky called null as “The Million Dollar Mistake”, this pegs the question - how does Scala deal with emptiness? Is it any better than Java? To formulate an opinion for that question we have to know about four classes that can be used in Scala to convey the lack of a value – Nil, None, Nothing, Null. ...

March 9, 2019 · 2 min · Manoj Mallela

New York, New York

The Flatiron Madison Square Park Madison Ave Yellow Cab, Newsstand and Grand Central

June 24, 2018 · 1 min · Manoj Mallela

AWS Instances – Dollar Store Edition

Visualizations of various AWS Instance parameters 1 1. Total ECUs 2. Memory 3. How many instances can I get for $1 4. How many ECUs can I get for $1 5. How much memory can I get for $1 6. How much storage can I get for $1 7. How much EBS Throughtput(Gbps) can I get for $1 Excluding T2 {nano, micro, medium} instances. Calculations are based on hour based pricing. ↩︎ ...

February 21, 2018 · 1 min · Manoj Mallela