Development of an AI-Based Virtual Camera Tracking System for Coarse Alignment of Mobile Free Space Optical Communication (FSOC) Terminals

Background Free Space Optical Communication (FSOC) offers unprecedented advantages for next-generation mobile networks, including gigabit-to-terabit data rates, license-free spectrum operation, high immunity to electromagnetic interference, etc. However, deploying FSOC links between mobile platforms (satellites, UAVs presents a severe challenge of pointing, acquisition and tracking (PAT) of highly narrow laser beams. PAT typically happens in two stages: coarse alignment and fine alignment. Coarse alignment is one of the key challenges of PAT, where the transmitting terminal must first locate and maintain the remote terminal within its camera Field-of-View (FOV).

Developing and testing such algorithms on real hardware requires expensive cameras, pan-tilt mechanisms, and optical components & equipment. A software based virtual camera tracking provides an inexpensive and accessible platform for algorithm development and learning.

Description Unlike conventional radio-frequency systems, FSOC relies on a highly directional optical beam. Even a small angular error can prevent successful communication. Before fine pointing mechanism can take over, a coarse alignment stage must:

• Observe the surrounding environment,
• Acquire and detect the remote terminal or beacon,
• Estimate the position, and
• Continuously adjust the pointing direction to maintain visibility.

The participants shall develop this coarse alignment process in software, allowing to develop and validate tracking algorithms without specialized hardware and setup. The following section provides reference parameters and performance criteria to be considered for the software development.

Parameters and Specifications Functional Objective: Develop a software system that autonomously detects, identifies, and continuously tracks a designated moving target within a virtual scene by controlling a virtual camera viewport.

Add 'Parameters and Specifications' table here Expected Solution Participants shall develop an AI-assisted camera tracking system capable of automatically detecting and continuously tracking a moving optical beacon in a simulated video stream while controlling a virtual pan-tilt camera.

The developed software shall be able to

• Generate a configurable virtual environment,
• Generate one or more moving targets,
• Implement a movable virtual camera,
• Detect the target beacon automatically,
• Track the beacon continuously using computer vision,
• Control and reposition the virtual camera,
• Generate and introduce disturbances due to atmospheric turbulence, platform vibrations, camera motion, noise, etc., in the virtual camera feed,
• Display tracking performance and statistics in real-time Deliverables Each participating team shall submit the following mandatory deliverables:

Software Application A standalone executable application implementing the complete virtual camera tracking system. The application shall provide all the mandatory functions and features as described above.

Source Code Complete source code with proper documentation. The code shall be modular and adequately commented.

Technical Report The technical report (about 10-15 pages) containing problem understanding, system architecture, description of software modules, tracking methods, AI methods (if used), test methodology, performance analysis and future improvements shall be submitted.

User Manual The user manual with the description of installation of software, application operation, parameter configuration, GUI description, etc. shall be submitted. A 3–5 minutes video may also be provided as an optional deliverable for demonstration of the application.

Performance Log The software should be capable of automatically generating a performance report containing simulation duration, FPS, acquisition time, average and maximum tracking error, lock retention rate, processing time, etc.

Evaluation Method and Criteria The solutions developed by participating teams will be evaluated using multi-layered evaluation method. The following table describes stages of evaluation, their weightage and methods.

Add 'Evaluation Method and Criteria' table here