System integrators agree that deploying video analytics varies project-by-project, requiring careful scrutiny of each site for optimum performance. Outdoor and indoor considerations are case-specific, often mandating nonstandard operating procedures to achieve a working solution.
Analytics deployments face common challenges. First, users must specify what rules to apply to which cameras and if the rules are compatible with the camera type and placement. Second, depending on the algorithms chosen, outdoor and indoor considerations must be factored in.
Camera Considerations
It is not uncommon for users to request several rules on the same camera, which can result in poor performance, said Daniel Horan, Integrated Systems Specialist, SimplexGrinnell (a division of Tyco Fire & Security). The type of camera and where it is positioned can affect the performance of video content analysis (VCA).
For example, certain algorithms for motion tracking are better positioned at elevated heights, roughly 6 meters. Algorithms for detecting object removal or left behind are better deployed at lower heights, where the object will be larger in pixels. Combining the two on one camera can be a problem, said Justin Schorn, VP of Product Development at Aimetis.
Advanced algorithms today have higher tolerance for imperfect angles, but the basic VCA system still demands some adjustment, or accuracy can be compromised up to a low 30- to 40-percent, Lim said.
Outdoor Performance
Outdoor performance has improved with different tactics. Employing sophisticated background options, adding more processors or using dual sensors tackle environmental obstacles such as weather, lighting, and other nuisances.
"Traditional video motion detection carries an inherent flaw — it assumes that any pixel change is significant. This is where the issue of outdoor performance becomes challenging," Schorn said. The movements of people, wind, rain, shadows and light reflections can cause pixel change. Traditional motion detection will alert on all changes, creating an unmanageable number of false alarms.
Increasing processing power is another option. "Our cameras have five onboard processors. Four are dedicated to cleaning up imaging problems associated with outdoor environments, which would otherwise cause false alarms, and the fifth runs the analytics," said John Romanowich, CEO of SightLogix. Without effective image processing, the alternative would be to lower the system's sensitivity, which is often unacceptable for outdoor applications.
Extreme Weather
Extreme weather changes, such as torrential rain, snow or fog, challenge VCA systems. "The more intelligent systems perform quite well, even under conditions of heavy snow," Lim said. "In such cases, it is difficult for the human eye to see a car, but advanced analytics are capable of this detection."
In subzero or blazing temperatures, heat dissipation becomes a bigger concern for edge devices. Edge devices have more components than standard devices,
Weather can cause false alarms in indoor scenarios, where there are large glass windows and doors. Variable lighting and shadows change the scene, Schorn said.
Variable Lighting
Lighting is a continuous uphill battle, and arguably, the most trying. "Although some advanced VCA systems can perform in low-light conditions, total darkness is still a big problem. We advise customers, whenever possible, to provide good lighting for optimum performance," Lim said.
Rectifying ambient light includes better camera placement. "When the camera is
Some vendors mask areas of the image that are bombarded by backlighting and shadows, said Zvika Ashani, CTO and co-founder of Agent Video Intelligence. These blind spots help manage false alarms.
The most difficult scenarios are large areas with bright sun and crowds. In such cases, thermal and megapixel cameras produce better performance. "The heat contrast from the thermal camera will give more accurate interpretations of movement, and the megapixel camera can validate the alarm," Holmstrom said.
Indoor Requirements
Indoor deployments are more controlled environments, but still challenging. The biggest problem is crowd control. Whether for business intelligence or security, crowds represent fast-changing movement and can result in false alarms.
Generally, more activity causes more false alarms. For people counting algorithms deployed in retail, people moving closely increases the possibility of
Large crowds of slow-moving people who are densely packed affect accuracy, such as at trade shows or concerts. "People counting works best when there is constant traffic flow moving through the camera field of view," Schorn continued.
Ceiling-mounted cameras can improve accuracy. "If you have a camera that counts people from the side, factors such as height differences and being blocked by people standing in front will negatively affect the count," said Pauline Marin, Marketing Manager of Keeneo. Retail algorithms can accurately count a person pushing a trolley.
Most retail applications mount cameras at a 45-degree angle. "The main issue is separating people in a crowd, and in our experience, out of 15 people, analytics deployed under these conditions detected only four," Holmstrom said.
With existing systems, overhead cameras are not preferred, since it requires separate cameras for analytics and monitoring. "Ceilingmounted cameras will not allow operators to see a person's face, which is a non-negotiable feature of video surveillance," Holmstrom said.