Open Source End-to-End Deep Learning Hardware Compiler Stack in use at Alibaba Cloud, AMD, ARM, AWS, Facebook, Huawei, Intel, Microsoft, NVIDIA, and Xilinx, among others.

Wilmington, DE —30 November 2020— The Apache Software Foundation (ASF), the all-volunteer developers, stewards, and incubators of more than 350 Open Source projects and initiatives, announced today Apache® TVM™ as a Top-Level Project (TLP).

The ASF's first  full stack software and hardware co-optimization project, Apache TVM is an end-to-end open deep learning compiler stack for CPUs, GPUs, and specialized accelerators. TVM enables machine learning developers to optimize and run computations efficiently on any hardware backend. The project originated in 2017 as a research project at Washington University and entered the Apache Incubator in March 2019.

"It is amazing to see how the Apache TVM community members come together and collaborate under The Apache Way," said Tianqi Chen, Vice President of Apache TVM. "Together, we are building a solution that allows machine learning engineers to optimize and run computations efficiently on any hardware backend."

Apache TVM’s extensible full-stack framework enables deep learning applications to efficiently deploy across an array of hardware modules, platforms, and systems, including mobile phones, wearables, specialized chips, and embedded devices. Features include:

  • High Performance: compilation and minimal runtimes commonly unlock ML workloads on existing hardware.

  • Runs Everywhere: automatically generates and optimizes tensor operators on backends, CPUs, GPUs, browsers, microcontrollers, FPGAs, ASICs, and more.

  • Flexible: deep learning compilation models in Keras, Apache MXNet (incubating), PyTorch, Tensorflow, CoreML, and DarkNet, among other libraries. Supports block sparsity, quantization, random forests/classical ML, memory planning, MISRA-C compatibility, Python prototyping, and more.

  • Easy to Use: easily build out production stacks using C++, Rust, Java, or Python. Deploy deep learning workloads across diverse hardware devices.


Apache TVM is in use at dozens of organizations and institutions that include Alibaba Cloud, AMD, ARM, AWS, Carnegie Mellon University, Cornell University, Edge Cortix, Facebook, Huawei, Intel, ITRI, Microsoft, NVIDIA, Oasis Labs, OctoML, Qualcomm, University of California/Berkeley, UCLA, University of Washington, Xilinx, and more.

"ML compilers and runtimes thrive on diversity of models supported and HW targets, which is a perfect way to show the power of Open Source communities," said Luis Ceze, CEO of OctoML and Professor at the University of Washington. "It has been fantastic to see Apache TVM's fast adoption among hardware vendors and ML end-users, being well on its way to becoming a de-facto industry standard."

"Apache TVM brings unique value to deep learning researchers and developers. It closes the gap between model development and the demand to efficiently deploy it on various hardware targets," said Yizhi Liu, Senior Software Development Engineer at AWS and member of the Apache TVM Project Management Committee. "I'm thrilled to see Apache TVM now becomes the Top-Level Project and looking forward to further collaboration with the community."

"Congratulations to the Apache TVM community for graduating to be one of the Top Level Projects of The Apache Software Foundation," said Henry Saputra, ASF Member and Apache TVM Incubating Mentor. "The Apache TVM ecosystem has a healthy mix of representation and contribution from the industries and academia that provides a good balance of innovations and production readiness for wider and faster adoption. As one of the mentors of the podling, I am grateful and glad to be part of the journey."

"The key to Apache TVM's success is its open community," added Chen. "We welcome everyone interested in the field to join us and shape the future of ML compilation together under The Apache Way."

Catch Apache TVM in action at the annual TVM Conference being held 2-4 December 2020. The online event is free of charge to participate: for more information and to register, visit https://tvmconf.org/  

Availability and Oversight
Apache TVM software is released under the Apache License v2.0 and is overseen by a self-selected team of active contributors to the project. A Project Management Committee (PMC) guides the Project's day-to-day operations, including community development and product releases. For downloads, documentation, and ways to become involved with Apache TVM, visit http://tvm.apache.org/ and https://twitter.com/ApacheTVM 

About the Apache Incubator
The Apache Incubator is the primary entry path for projects and codebases wishing to become part of the efforts at The Apache Software Foundation. All code donations from external organizations and existing external projects enter the ASF through the Incubator to: 1) ensure all donations are in accordance with the ASF legal standards; and 2) develop new communities that adhere to our guiding principles. Incubation is required of all newly accepted projects until a further review indicates that the infrastructure, communications, and decision making process have stabilized in a manner consistent with other successful ASF projects. While incubation status is not necessarily a reflection of the completeness or stability of the code, it does indicate that the project has yet to be fully endorsed by the ASF. For more information, visit http://incubator.apache.org/ 

About The Apache Software Foundation (ASF)
Established in 1999, The Apache Software Foundation (ASF) is the world’s largest Open Source foundation, stewarding 227M+ lines of code and providing more than $20B+ worth of software to the public at 100% no cost. The ASF’s all-volunteer community grew from 21 original founders overseeing the Apache HTTP Server to 813 individual Members and 206 Project Management Committees who successfully lead 350+ Apache projects and initiatives in collaboration with nearly 8,000 Committers through the ASF’s meritocratic process known as "The Apache Way". Apache software is integral to nearly every end user computing device, from laptops to tablets to mobile devices across enterprises and mission-critical applications. Apache projects power most of the Internet, manage exabytes of data, execute teraflops of operations, and store billions of objects in virtually every industry. The commercially-friendly and permissive Apache License v2 is an Open Source industry standard, helping launch billion dollar corporations and benefiting countless users worldwide. The ASF is a US 501(c)(3) not-for-profit charitable organization funded by individual donations and corporate sponsors including Aetna, Alibaba Cloud Computing, Amazon Web Services, Anonymous, Baidu, Bloomberg, Budget Direct, Capital One, Cerner, Cloudera, Comcast, Facebook, Google, Handshake, Huawei, IBM, Inspur, Pineapple Fund, Red Hat, Target, Tencent, Union Investment, Verizon Media, and Workday. For more information, visit http://apache.org/ and https://twitter.com/TheASF 

© The Apache Software Foundation. "Apache", "TVM", "Apache TVM", and "ApacheCon" are registered trademarks or trademarks of the Apache Software Foundation in the United States and/or other countries. All other brands and trademarks are the property of their respective owners.

# # #