Software 2.0

Software 2.0 is software based artificial intelligence and defined by weights in a large language model.

Andrej Karpathy, a prominent Al researcher and former senior director of Al at Tesla, coined the term
"Software 2.0"

Software 2.0 refers to a new paradigm in software development where traditional programming is replaced by machine learning models. Instead of writing explicit code, developers create and train neural networks that learn from data to perform tasks. This approach allows software to solve complex problems like image recognition, natural language processing, and more, by learning from examples rather than following predefined rules.

Most of the large language models we use aren’t compiled code. They are all software 2.0. The software that full self drives my Tesla is software 2.0.