Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Feedbacks? #2

Open
nevillelyh opened this issue Jun 9, 2020 · 5 comments
Open

Feedbacks? #2

nevillelyh opened this issue Jun 9, 2020 · 5 comments

Comments

@nevillelyh
Copy link
Owner

Please give feedback on the entire collection of Koans overall:

  • Structure
  • Continuity
  • User experience
  • Missing topics
  • What else?

And on individual Koans:

  • Too easy/hard?
  • Too little/much hint?
  • Context?
  • What else?
@RickardZwahlen
Copy link

There's a pesky warning that is pretty spammy:

[info] Using a fallback coder for Avro's GenericRecord is discouraged as it is VERY inefficient.
[info] It is highly recommended to define a proper Coder[GenericRecord] using:
[info] 
[info]   Coder.avroGenericRecordCoder(schema)
[info]         
[info]   val scioGeneric: Coder[GenericRecord] = Coder[GenericRecord]```

It would also be great if the loop could print which Koan it is currently at, or something to track progress. 

@nevillelyh
Copy link
Owner Author

Added some progress info:
cee112c
37243d9

The coder warning is tricky. It seems to be caused by Jmh / compile which rebuilds everything every time. I'll look into calling that only when the current test is a JmhKoan.

@nevillelyh
Copy link
Owner Author

The compilation issue should be fixed by 5a457a3.

@pacuna
Copy link

pacuna commented Jul 11, 2022

Hi @nevillelyh, some of the examples are not passing the benchmark tests. One example is the second test for K02_Converter2. My solution was failing"

K02_Converter2:
[info] Revisions
[info] - should return the same result as baseline
[info] - should be faster than baseline *** FAILED ***
[info]   Benchmark v2: 6353.159808376573 was not greater than or equal to 18213.053241034377 (JmhKoan.scala:103)

And I checked the diff and it was the same answer as the solution diff. I had the same issue with other exercises as well.
I can document the other ones I've found if you want to.

Edit: Might be the versions?:

sbt version in this project: 1.6.2
openjdk version "11.0.14" 2022-01-18 LTS
Scala code runner version 3.1.1 -- Copyright 2002-2022, LAMP/EPFL

@nevillelyh
Copy link
Owner Author

@pacuna yeah these JMH benchmarks are not deterministic and result can vary due to JVM, system load, etc.
You can increase their chance of passing by increasing bench iterations or time but that also slows down iteration speed.
https://github.com/nevillelyh/scio-koans/blob/main/src/test/scala/scio/koans/shared/JmhKoan.scala#L29-L31

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants