Computer vision differs from human vision because computers do not naturally understand images and videos in the same flexible way that humans do. Instead, computers rely on specific algorithms and assumptions to identify useful information from pixels. For example, an algorithm may need movement, differences in brightness, or differences between an object and its background in order to detect something. Because of this, computer vision can be sensitive to changes in lighting, background, or whether an object is moving.
There are several techniques we can use to help computers see and track what we are interested in. Frame differencing can be used to detect movement by comparing two video frames, while background subtraction can separate people or objects from a known background. Brightness thresholding can also identify objects based on how light or dark they are, and brightness tracking can be used to follow a bright object such as a flashlight. We can also improve computer vision by designing the physical environment, such as using strong lighting, high contrast.
I think computer vision’s ability to track and surveil people can make interactive art more interesting and responsive, but it also raises concerns about privacy, consent, and how people’s information is used. For example, people may feel uncomfortable if a camera is tracking their movements or recording their images without them knowing. I think artists can address these ethical issues by clearly informing participants about what is being collected, how the information will be used, and whether it will be stored or shared. They should also give people the choice to participate or not whenever possible. At the same time, artists can use surveillance itself as a theme to make people think about how technology is used to monitor and understand people. Therefore, I think computer vision can be very powerful in interactive art, but it should be used in a way that respects people’s privacy and gives them a clear understanding of what is happening.