Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

MySQL-MySQL full copy triggers OOM #987

Open
LordofAvernus opened this issue Jun 9, 2022 · 0 comments
Open

MySQL-MySQL full copy triggers OOM #987

LordofAvernus opened this issue Jun 9, 2022 · 0 comments
Assignees

Comments

@LordofAvernus
Copy link
Collaborator

LordofAvernus commented Jun 9, 2022

Description

Steps to reproduce the issue

  1. create a big database
    SQL:

  2. create MySQL-MySQL job
    job_json:

      {
            "job_id":"mySQL",
            "src_task":{
                "connection_config":{
                    "database_type":"MySQL",
                    "host":"10.186.61.106",
                    "port":33061,
                    "user":"root",
                    "password":"***QJlyoKkG3GMu8dLL1Fq7AmQittyJJabPFYwDUyG0c="
                },
                "node_id":"",
                "mysql_src_task_config":{
                    "gtid":""
                },
                "drop_table_if_exists":true,
                "binlog_relay":false,
                "repl_chan_buffer_size":120,
                "group_max_size":1,
                "group_timeout":100,
                "chunk_size":2000,
                "task_name":"src",
                "skip_create_db_table":false,
              "replicate_do_db": [
         ]
        },
            "is_password_encrypted":true,
            "dest_task":{
                "connection_config":{
                    "database_type":"MySQL",
                    "host":"10.186.61.106",
                    "port":33062,
                    "user":"root",
                    "password":"***2fT/6DZAvKD13Hyk2kIbIAY="
                },
                "node_id":"",
                "mysql_dest_task_config":{
                },
                "task_name":"dest"
            },
            "task_step_name":"job_stage_incr",
            "failover":true,
            "retry":2
        }
  1. curl -X POST "http://10.186.61.75:8190/v2/job/sync/create" -H "accept: application/json" -H "Authorization: $token" -H "Content-Type: application/json" -d "$job_json"

Describe the results you received

origin_img_v2_14e9d938-fa0f-4e95-afe1-696c682f260g
origin_img_v2_0345cfa6-c25f-45d2-8acd-c4b3fa8bfa9g

Describe the results you expected

Insufficient memory to pause replication

Output of ./dtle version:**

9.9.9.9-master-40fbcbe8

Additional information

[]# free -h
total used free shared buff/cache available
Mem: 15G 2.3G 12G 532K 678M 12G
Swap: 0B 0B 0B

@LordofAvernus LordofAvernus added this to the 4.22.07.0 milestone Jul 4, 2022
@LordofAvernus LordofAvernus self-assigned this Jul 4, 2022
@LordofAvernus LordofAvernus removed this from the 4.22.07.0 milestone Jul 15, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant