GameScrapper

Trabalho da disciplina de Tópicos Especiais em Gerência de Dados da UFSC

Sobre

Utilizando o framework Scrapy criamos crawlers com o objetivo de coletar dados sobre venda de jogos.

Lojas alvo

• Steam
• Epic Games
• Gog

Atributos Coletados

• Nome
• Preço
• Data de lançamento
• Gêneros
• Desenvolvedora
• Editora

Dados coletados

Analisando os JSONs gerados ao tratar todos os dados temos os seguintes gráficos:

• Overall prices

Class - Count - Percentage - Distribution
  0.00 -  49.20 | 9445 | 79.79% | ███████████████████████████████████████
 49.20 -  98.40 | 1687 | 14.25% | ███████
 98.40 - 147.60 |  362 |  3.06% | █
147.60 - 196.80 |  145 |  1.22% | 
196.80 - 246.00 |   84 |  0.71% | 
246.00 - 295.20 |   55 |  0.46% | 
295.20 - 344.40 |   18 |  0.15% | 
344.40 - 393.60 |   19 |  0.16% | 
393.60 - 442.80 |    6 |  0.05% | 
442.80 - 492.00 |    2 |  0.02% | 
492.00 - 541.20 |    9 |  0.08% | 
541.20 - 590.40 |    0 |  0.00% | 
590.40 - 639.60 |    0 |  0.00% | 
639.60 - 688.80 |    0 |  0.00% | 
688.80 - 738.00 |    0 |  0.00% | 
738.00 - 787.20 |    1 |  0.01% | 
787.20 - 836.40 |    1 |  0.01% | 
836.40 - 885.60 |    2 |  0.02% | 
885.60 - 934.80 |    1 |  0.01% |
934.80 - 984.00 |    1 |  0.01% |

Total Count: 11838

• Cheaper than 100

Class - Count - Percentage - Distribution
 0.00 -  5.00 | 1808 | 16.14% | ████████
 5.00 - 10.00 | 1298 | 11.59% | █████
10.00 - 15.00 | 1508 | 13.46% | ██████
15.00 - 20.00 | 1172 | 10.46% | █████
20.00 - 25.00 |  789 |  7.04% | ███
25.00 - 30.00 | 1029 |  9.19% | ████
30.00 - 35.00 |  469 |  4.19% | ██
35.00 - 40.00 |  791 |  7.06% | ███
40.00 - 45.00 |  191 |  1.71% |
45.00 - 49.99 |  473 |  4.22% | ██
49.99 - 54.99 |  244 |  2.18% | █
54.99 - 59.99 |  478 |  4.27% | ██
59.99 - 64.99 |   84 |  0.75% |
64.99 - 69.99 |  147 |  1.31% |
69.99 - 74.99 |  206 |  1.84% |
74.99 - 79.99 |  139 |  1.24% |
79.99 - 84.99 |   85 |  0.76% |
84.99 - 89.99 |  140 |  1.25% |
89.99 - 94.99 |   53 |  0.47% |
94.99 - 99.99 |   98 |  0.87% |

Total Count: 11202 

• Cheaper than 10

Class - Count - Percentage - Distribution
0.00 - 0.50 | 891 | 28.69% | ██████████████
0.50 - 1.00 |  11 |  0.35% |
1.00 - 1.50 |  23 |  0.74% |
1.50 - 2.00 |  51 |  1.64% |
2.00 - 2.50 | 178 |  5.73% | ██
2.50 - 3.00 | 180 |  5.80% | ██
3.00 - 3.50 |  99 |  3.19% | █
3.50 - 4.00 |  92 |  2.96% | █
4.00 - 4.50 | 211 |  6.79% | ███
4.50 - 5.00 |  72 |  2.32% | █
5.00 - 5.49 | 141 |  4.54% | ██
5.49 - 5.99 | 109 |  3.51% | █
5.99 - 6.49 | 199 |  6.41% | ███
6.49 - 6.99 | 143 |  4.60% | ██
6.99 - 7.49 | 107 |  3.44% | █
7.49 - 7.99 | 128 |  4.12% | ██
7.99 - 8.49 | 111 |  3.57% | █
8.49 - 8.99 | 171 |  5.51% | ██
8.99 - 9.49 |  96 |  3.09% | █
9.49 - 9.99 |  93 |  2.99% | █

Total Count: 3106

• By year

Class - Count - Percentage - Distribution
1980 - 1982 |    1 |  0.01% |
1982 - 1984 |    4 |  0.03% |
1984 - 1986 |    5 |  0.04% |
1986 - 1988 |   24 |  0.20% |
1988 - 1991 |   85 |  0.71% |
1991 - 1993 |   86 |  0.71% |
1993 - 1995 |  114 |  0.95% |
1995 - 1997 |  135 |  1.12% |
1997 - 1999 |  161 |  1.34% |
1999 - 2002 |  217 |  1.80% |
2002 - 2004 |  128 |  1.06% |
2004 - 2006 |  129 |  1.07% |
2006 - 2008 |  110 |  0.91% |
2008 - 2010 |  136 |  1.13% |
2010 - 2013 |  309 |  2.57% | █
2013 - 2015 |  530 |  4.41% | ██
2015 - 2017 | 1043 |  8.67% | ████
2017 - 2019 | 1405 | 11.68% | █████
2019 - 2021 | 1969 | 16.37% | ████████
2021 - 2024 | 5438 | 45.21% | ██████████████████████

Total Count: 12029