When ingesting tables from a connector, why are older tables getting deleted from OpenMetadata?

[ShilpaVernekar]

When ingesting tables from the Hive connector, I'm using the parameter tableFilterPattern in the JSON file to select specific tables to ingest into OpenMetadata. However, the older tables are getting deleted. Please check.

Originally answered in Slack support

[ShilpaVernekar]

Please ensure that markDeletedTables is disabled in the JSON config.
The JSON config should be as follows:

{
  "source": {
    "type": "hive",
    "serviceName": "local_hive",
    "serviceConnection": {
      "config": {
        "type": "Hive",
        "hostPort": "localhost:10000",
        "username": "",
        "password": "",
        "database": ""
      }
    },
    "sourceConfig": {
      "config": {
        "enableDataProfiler": false,
        "markDeletedTables": false
      }
    }
  },
  "sink": {
    "type": "metadata-rest",
    "config": {}
  },
  "workflowConfig": {
    "openMetadataServerConfig": {
      "hostPort": "http://localhost:8585/api",
      "authProvider": "no-auth"
    }
  }
}