in

Airflow 2.7 Is Now Out


Listed here are an important function updates that may make your life simpler and prevent time

Picture generated through DALL-E-2 utilizing immediate “information flowing from exterior system into vacation spot system as a system design graph, digital artwork”

Apache Airflow 2.7.0 is lastly out and we’re all excited to see all these notable options being shipped on this newest launch. The brand new model consists of 40 new options, 53 bug fixes, 49 enhancements and 15 documentation updates.

The principle focus of this launch has been safety however on the similar time, many thrilling non-security associated options have additionally been made obtainable.

The brand new Cluster Exercise UI

As of Airflow 2.7.0, a brand new tab is launched within the high stage menu of the Airflow UI and is named Cluster Exercise.

The brand new Cluster Exercise UI offers an summary of the general cluster state, together with part well being (for MetaDatabase, Scheduler, Triggerer and DAG processor) in addition to particulars about DAG/Activity run states and DAG run sorts.

The brand new Cluster Exercise UI is shipped as a part of the brand new Airflow 2.7.0 launch — Supply: Creator

See when the supply code was final parsed

Previously I used to be actually irritated by the truth that I couldn’t actually see whether or not the modifications I used to be making to the supply code of a selected DAG had been really parsed. I might normally must refresh the web page (a number of instances) and begin in search of the precise areas within the supply code that I utilized some modifications with the intention to make sure that they’ve been parsed so I can re-trigger the DAG.

The brand new Airflow model introduces a Parsed at subject inside the Code tab of a DAG, indicating the timestamp when the DAG’s supply code was final up to date.

The brand new code tab features a timestamp indicating when the DAG supply code was final parsed — Supply: Creator

Easy however but helpful addition!

Keyboard shortcut assist

Airflow Grid view now additionally helps keyboard shortcuts. When you enter the Grid display of a DAG, you’ll discover a word simply beneath filtering part, indicating that you could entry the checklist of supported shortcuts…


Program-Aided Language Fashions. LLMs can write code, however what in the event that they… | by Cameron R. Wolfe, Ph.D. | Aug, 2023

Machine-learning system primarily based on mild may yield extra highly effective, environment friendly massive language fashions | MIT Information