Improve Audio Data Processing and Spectrum Analyzer #745
Conversation
kblaschke
force-pushed
the
bugfix/fix-spectrum-analyzer
branch
2 times, most recently
from
89fbe8e
to
9f411fe
Compare
| * You might want to slightly damp (blur) the input if your signal isn't | ||
| * of a very high quality, to reduce high-frequency noise that would | ||
| * otherwise show up in the output. |
There was a problem hiding this comment.
is there any audio we expect people to feed in that will not be of "a very high quality"?
There was a problem hiding this comment.
Don't know, probably not relevant anymore today. Most of the Doxygen text in this class is just a 1:1 copy of the comments in Milkdrop's code, I didn't change it for "historical reasons". 😁
| @@ -0,0 +1,55 @@ | |||
| /** | |||
| * @file WaveformAligner.hpp | |||
| * @brief Mip-based waveform alignment algorithm | |||
There was a problem hiding this comment.
Yeah... Will just keep the class doc, and only add a "brief" description for the file.
| /** | ||
| * @brief Calculates equalization factors for each frequency domain. | ||
| * | ||
| * @param equalize If false, all factors will be set to 1, otherwise will calculate a frequency-based multiplier. |
There was a problem hiding this comment.
what's the purpose of the equalizer?
There was a problem hiding this comment.
From what I understand of the code, it adds a log-based scaling curve over the frequencies. I don't know the reasoning behind this, so I just kept the code as-is to match Milkdrop's spectrum analyzer results.
The equalizer curve which is applied to the frequency bands looks like this:
There was a problem hiding this comment.
The envelope table, which is also used for scaling the input waveform samples (basically using more of the waveform's center than the edges), looks like this:
Removed the previous FFT algorithm, now using a modernized version of the original Milkdrop FFT transform which also has both an equalizer and frequency envelope, making it slightly more sophisticated. Modernization mainly included replacing raw pointer arrays with std::vector and using STL types/functions for the calculation, specifically std::complex as the FFT heavily uses these numbers. This makes the code more compact and readable. Manually tested both original and modernized versions of the class to test if the algorithm still returns the exact same results, which is the case.
Consolidated audio processing code into the PCM class, removing the BeatDetect class in the process. Beat detection now uses the same algorithm as Milkdrop, passing the proper relative bass/mid/treb values to presets. Makes many presets look less jumpy/flickering, as the values are now (smoothly) alternating around 1.0. Updating frame audio is now done in a function that must specifically be called. Any subsequent calls to GetFrameAudioData() will then return the exact same copy of the audio data. As of now with the exception that new waveform data may be passed in via a separate thread, which will then be returned and might not match the spectrum data. Will fix that in a later commit.
Also consolidated the waveform sample count constant to keep it aligned over all classes.
The "+1" somehow disappeared at some point...
Directly passing references to the affected members is easier to read in the main UpdateFrameAudioData() method.
kblaschke
force-pushed
the
bugfix/fix-spectrum-analyzer
branch
from
dd4053b
to
9c68339
Compare
Reimplemented audio data processing to closely match Milkdrop's algorithms and resulting sample/spectrum values.
proejctM's previous implementation was very simplistic, and thus resulted in sample/beat detection values which weren't even close to what Milkdrop passes to presets. This PR changes/fixes the following audio-related issues:
FFTclass. It also smoothes and equalized the spectrum a bit to remove noise. Now spectrum-based custom waveforms draw properly.Fixes issue #708.