[Bug][Github: Extract Users] avatar_url data too long error

[krishnaku]

Search before asking

• I had searched in the issues and found no similar issues.

What happened

DevLake: v1.0.1@e061ef2

I ran into an import error while trying to process the Github repo for Devlake.

Tracked it down to the loading of the table _tool_github_accounts from _raw_github_account

I resolved it by changing the type of the avatar_url column from VARCHAR(255) to TEXT.
Repeated the same for table accounts.

I was able to work around this issue with this fix, but reporting anyway.

logging (3).tar.gz

What do you expect to happen

Script should run without errors.

How to reproduce

1. Create a Github connection.
2. Connect to apache/incubator-devlake project.
3. Set up project with default settings with this connection.
4. Collect data.

Anything else

No response

Version

v1.0.1@e061ef2

Are you willing to submit PR?

• Yes I am willing to submit a PR!

Code of Conduct

• I agree to follow this project's Code of Conduct

[dosubot]

Hey @krishnaku! 👋 I'm here to help you with any bugs, questions, or contributions. I'll assist you while we wait for a human maintainer.

The issue you're encountering is due to the avatar_url field being defined as VARCHAR(255), which is causing a "data too long" error when the URL exceeds this length. This field is indeed defined with a maximum length of 255 characters in the codebase ^[1].

You've resolved the issue by changing the column type to TEXT, which allows for longer URLs. This is a practical workaround, but it might be worth considering if this change should be made in the main codebase to prevent similar issues for other users.

If you're willing to submit a pull request, you could propose this change to the repository maintainers. It would be helpful to include your findings and the rationale for changing the column type to TEXT to accommodate longer URLs.

To continue talking to Dosu, mention @dosu.

---

^{Help Dosu learn! Give it feedback: Great Response | Irrelevant Answer | Incorrect Sources | Too Verbose | Hallucination | Other}