Create Sitemap for Better SEO

[MohammadPCh]

We need to generate a sitemap for our website to search engines can find our pages better and easier. now they can only crawl pages linked to our popular pages (homepage or first load of projects).
I suggest creating the sitemap once per day. We need the devOps team's help with this.
@aminlatifi @MoeNick

[MohammadPCh]

This google doc for Sitemap:
https://developers.google.com/search/docs/advanced/sitemaps/overview

[divine-comedian]

@mhmdksh @MohammadPCh - is this issue still relevant?

I'm VERY interested in improving our SEO.

[divine-comedian]

@mhmdksh can you please provide an update on this issue?

[mhmdksh]

@mhmdksh can you please provide an update on this issue?

@divine-comedian Sorry I can't provide any update on this neither this is my field of expertise. I prefer if I get unassigned as this is a Frontend/SEO-Optimization issue, not Devops work.

Thanks

@MohammadPCh Anyone can take this??

[divine-comedian]

@MohammadPCh can this issue be passed to someone or what is the next course of action?

[MohammadPCh]

@kkatusic @lovelgeorge99 @Reshzera Hey everyone, who has the bandwidth to take this on?

We need a script to:

1. Retrieve projects, users, and campaigns from the server
2. Add the static pages
3. Create a sitemap

Let me know if you need any help.

[kkatusic]

@kkatusic @lovelgeorge99 @Reshzera Hey everyone, who has the bandwidth to take this on?

We need a script to:

1. Retrieve projects, users, and campaigns from the server
2. Add the static pages
3. Create a sitemap

Let me know if you need any help.

I will take it, thx @MohammadPCh

[kkatusic]

@divine-comedian and @MohammadPCh, cc @CarlosQ96 is it ok to expose users inside sitemap?

[divine-comedian]

I am not sure about what the implications are so I would defer to what either of them think

[kkatusic]

Let's than wait @MohammadPCh and @CarlosQ96 response ;)

[MohammadPCh]

@kkatusic Yes we can add the public profile to the sitemap. but we should disallow the dashboard and private zones.

[kkatusic]

@kkatusic Yes we can add the public profile to the sitemap. but we should disallow the dashboard and private zones.

thx @MohammadPCh , let's hear also @CarlosQ96 response about this ;)

[CarlosQ96]

Ok we should make a query just to expose the minimum required info of users.
Also how often will the sitemap be generated? Ideally we could have a ipfs updated every day. I'm not sure a open public endpoint is that efficient even with cache. It's loading too much data into memory.

[CarlosQ96]

@kkatusic @MohammadPCh

[kkatusic]

@CarlosQ96 we can run cron job once per week, google will use that sitemap and I think it doesn't scan it every day

[CarlosQ96]

@kkatusic Sounds good to make the cronjob once per week. Exposing public data only.

[divine-comedian]

need to provide some back-end function for listing users, need to generate user sitemap only with public data on front-end.

@kkatusic please review and add estimate of when this can be completed.

[kkatusic]

need to provide some back-end function for listing users, need to generate user sitemap only with public data on front-end.

@kkatusic please review and add estimate of when this can be completed.

I will try to finish this week, but have now problem with BE, we will try to fix that before because I need BE functions also to finish this one.

[divine-comedian]

@CarlosQ96 can you give Giveth/impact-graph#1887 a review?

once BE is merged we can do FE