Improved Configuration Management

[wdbaruni]

Implement bacalhau configuration improvements as suggested in https://www.notion.so/expanso/Rethinking-Configuration-435fbe87419148b4bbc5119d413786eb

Tasks

Preview Give feedback

1. Allow users to provide configuration via --config or -c flags #4217
   th/config type/enhancement +2
   
2. Replace repo.version and update.json with system_metadata.yaml #4218
   th/config type/enhancement +2
   
3. Decouple Bacalhau repo from the configuration file. #4219
   th/config type/enhancement +2
   
4. Support requester level job defaults with a job template #3848
   th/config th/user-experience +2
   
5. Implement new configuration types #4323
   +0
   
6. Implement config migration #4324
   +0
   
7. Migrate Node Setup to use new config type #4336
   +0
   
8. Ensure config always has a DataDir set and remove dependency from repo pacakge #4337
   +0
   
9. Modify install script to populate installationID in the system_metadata.yaml file #4338
   +0