Holding something down rather than tapping causes difficulty for one group, and moving in a precise direction causes problems for another, so combining the two into a drag or swipe multiples the issue.
Other people rely on and enjoy these controls and find simple controls frustrating or less intuitive, so if you can, allow both.
Best practice example:
Category & Level:
- Motor (Intermediate)