chore: api changes for Datafusion 44

[rtyler]

This is currently a work in progress to help pre-test Datafusion 44 before it's released

[github-actions]

ACTION NEEDED

delta-rs follows the Conventional Commits specification for release automation.

The PR title and description are used as the merge commit message. Please update your PR title and description to match the specification.

[alamb]

I made a PR here to pin to a pre-release version of DataFusion for testing:

• chore: pin to pre-release DataFusion to test upgrade to 44 #3075

There are a bunch of deprecation warnings which I will work on but I am out of time today. Hopefully tomorrow

Thanks again @rtyler

[codecov]

Codecov Report

Attention: Patch coverage is 78.57143% with 3 lines in your changes missing coverage. Please review.

Project coverage is 72.29%. Comparing base (72311ed) to head (62ecf57).

Files with missing lines	Patch %	Lines
crates/core/src/delta_datafusion/expr.rs	50.00%	0 Missing and 1 partial ⚠️
crates/core/src/operations/optimize.rs	66.66%	0 Missing and 1 partial ⚠️
crates/sql/src/parser.rs	80.00%	1 Missing ⚠️

Additional details and impacted files

@@           Coverage Diff           @@
##             main    #3073   +/-   ##
=======================================
  Coverage   72.29%   72.29%           
=======================================
  Files         128      128           
  Lines       41165    41164    -1     
  Branches    41165    41164    -1     
=======================================
  Hits        29761    29761           
+ Misses       9492     9488    -4     
- Partials     1912     1915    +3     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.