Running studies on real systems for real tasks is harder than running controlled studies for new interaction techniques

1
1
posted Dec 15, 2018
"Yet doing such evaluation incurs a significant amount of time and engineering work, particularly compared to non-systems papers." (https://cacm.acm.org/blogs/blog-cacm/86066-what-makes-a-good-hci-systems-paper/fulltext) – Whathecode Jan 1, 2021 15:23
"The reviewers simply do not value the difficulty of building real systems and how hard controlled studies are to run on real systems for real tasks. This is in contrast with how easy it is to build new interaction techniques and then to run tight, controlled studies on these new techniques with small, artificial tasks (don't tell me this is not true as I have done it and published good papers of this style also)." (https://dubfuture.blogspot.com/2009/11/i-give-up-on-chiuist.html) – Whathecode Jan 1, 2021 15:29