With the recent development of new portable and lightweight EEG systems come numerous reports in popular science outlets but also more and more publications in peer reviewed journals reporting on experiments using such systems in stationary or ambulating participants.
Because proprietary systems do not provide access to the algorithms underlying the relevant output (e.g., detection of emotional state), the results of such studies are highly questionable. This is especially the case for approaches using ambulating participants. Here, gait and other movement-related artifacts distort the signal of interest and it is not clear how these non-brain activities impact the output.
While reports based on easy to use EEG systems without doubt further the increasing popularity of neuroscience in the general public, they might produce expectations that cannot be fulfilled (similar to the failed expectations regarding BCI research).
There has to be an open discussion with the aim to defining rules how to deal with research based on proprietary systems regarding publications.
Would you want EEG results to be published in peer-reviewed journals when there is no access to the algorithms producing the output?