简体中文 | English
Apache Airflow is a platform created by the community to programmatically author, schedule and monitor workflows.
Core Features:
- Log collection: Airflow can collect logs of various services and open them to various consumers through Airflow as a unified interface service, such as Hadoop, Hbase, Solr, etc.
- Metrics: Airflow is also frequently used to record operational monitoring data. Including collecting data from various distributed applications, producing centralized feedback for various operations such as alarms and reports.
- Streaming processing: can be integrated with Spark streaming and Flink for use.
- Flow limiting and peak clipping: Airflow can be used to write requests to Airflow when there are too many requests at a certain time in the Internet field, so as to avoid the service crash caused by directly requesting the back-end program.
Architecture Design:
This project offers pre-configured Airflow Workflow Platform images with Airflow and its runtime environment pre-installed, along with deployment templates. Follow the guide to enjoy an "out-of-the-box" experience.
System Requirements:
- CPU: 2GHz or higher
- RAM: 4GB or more
- Disk: At least 40GB
Register a Huawei account and activate Huawei Cloud
| Image Version | Description | Notes |
|---|---|---|
| Airflow2.1-kunpeng-v1.0 | Deployed on Kunpeng servers with Huawei Cloud EulerOS 2.0 64bit | |
| Airflow2.1-kunpeng-v1.0 | Deployed on Kunpeng servers with Ubuntu24.04 64bit |
- Submit an issue
- Contact Huawei Cloud Marketplace product support
- Fork this repository and submit a merge request.
- Update README.md synchronously based on your open-source mirror information.