4.5 Article

Ship Detection and Tracking in Inland Waterways Using Improved YOLOv3 and Deep SORT

Journal

SYMMETRY-BASEL
Volume 13, Issue 2, Pages -

Publisher

MDPI
DOI: 10.3390/sym13020308

Keywords

ship detection; inland waterways; real-time detection; YOLOv3; Deep SORT

Funding

  1. National Science Foundation of China [51879211]
  2. National Key Research and Development Project of China [2020YFB1710800]

Ask authors/readers for more resources

Ship detection and tracking in inland waterways is crucial for navigation safety. This paper introduces improvements to the YOLOv3 detection algorithm and its application in Deep SORT tracking algorithm, enhancing performance in ship detection and tracking. The enhanced algorithm shows increased precision and frame rate, with Deep SORT proving superior in complex scenarios.
Ship detection and tracking is an important task in video surveillance in inland waterways. However, ships in inland navigation are faced with accidents such as collisions. For collision avoidance, we should strengthen the monitoring of navigation and the robustness of the entire system. Hence, this paper presents ship detection and tracking of ships using the improved You Only Look Once version 3 (YOLOv3) detection algorithm and Deep Simple Online and Real-time Tracking (Deep SORT) tracking algorithm. Three improvements are made to the YOLOv3 target detection algorithm. Firstly, the Kmeans clustering algorithm is used to optimize the initial value of the anchor frame to make it more suitable for ship application scenarios. Secondly, the output classifier is modified to a single Softmax classifier to suit our ship dataset which has three ship categories and mutual exclusion. Finally, Soft Non-Maximum Suppression (Soft-NMS) is introduced to solve the deficiencies of the Non-Maximum Suppression (NMS) algorithm when screening candidate frames. Results showed the mean Average Precision (mAP) and Frame Per Second (FPS) of the improved algorithm are increased by about 5% and 2, respectively, compared with the existing YOLOv3 detecting Algorithm. Then the improved YOLOv3 is applied in Deep Sort and the performance result of Deep Sort showed that, it has greater performance in complex scenes, and is robust to interference such as occlusion and camera movement, compared to state of art algorithms such as KCF, MIL, MOSSE, TLD, and Median Flow. With this improvement, it will help in the safety of inland navigation and protection from collisions and accidents.

Authors

I am an author on this paper
Click your name to claim this paper and add it to your profile.

Reviews

Primary Rating

4.5
Not enough ratings

Secondary Ratings

Novelty
-
Significance
-
Scientific rigor
-
Rate this paper

Recommended

Review Engineering, Multidisciplinary

Review on non-isolated DC-DC converters and their control techniques for renewable energy applications

Farhan Mumtaz, Nor Zaihar Yahaya, Sheikh Tanzim Meraj, Balbir Singh, Ramani Kannan, Oladimeji Ibrahim

Summary: With the increasing need for energy consumption to meet global demands, hybrid renewable energy generation is being studied as an alternative to conventional methods. While renewable energy sources have drawbacks, such as variability in photovoltaic and wind systems and high costs for fuel cells, researchers are focusing on using power electronic devices like DC-DC converters to address these issues and improve efficiency. The selection and integration of appropriate DC-DC converters, along with control techniques like PID, SMC, MPC, SSM, and FLC, play a crucial role in enhancing the overall performance of power systems.

AIN SHAMS ENGINEERING JOURNAL (2021)

Article Engineering, Electrical & Electronic

Temperature and Strain Sensing With Hybrid Interferometer

Lashari Ghulam Abbas, Zhou Ai, Farhan Mumtaz, Atta Muhammad, Yutang Dai, Rashda Parveen

Summary: The study presents a hybrid interferometer design that utilizes a combination of different fiber types to achieve simultaneous measurement of strain and temperature. Experimental results demonstrate that the hybrid interferometer has high sensitivity and can be widely applied in various fields.

IEEE SENSORS JOURNAL (2021)

Article Chemistry, Analytical

Highly Sensitive Strain Sensor by Utilizing a Tunable Air Reflector and the Vernier Effect

Farhan Mumtaz, Muhammad Roman, Bohong Zhang, Lashari Ghulam Abbas, Muhammad Aqueel Ashraf, Yutang Dai, Jie Huang

Summary: A highly sensitive strain sensor based on tunable cascaded Fabry-Perot interferometers is proposed and experimentally demonstrated. The sensor exhibits optimum strain sensitivity and ultra-low temperature sensitivity, providing good performance for strain sensing.

SENSORS (2022)

Article Engineering, Electrical & Electronic

A Simple Optical Fiber SPR Sensor With Ultra-High Sensitivity for Dual-Parameter Measurement

Farhan Mumtaz, Muhammad Roman, Bohong Zhang, Lashari Ghulam Abbas, Muhammad Aqueel Ashraf, Muhammad Arshad Fiaz, Yutang Dai, Jie Huang

Summary: This work presents a highly sensitive optical fiber Surface Plasmon Resonance (SPR) sensor for simultaneous measurement of dual parameters. The sensor utilizes a D-shaped fiber with a nanolayer coating of Silver (Ag) and Hematite (alpha-Fe2O3), with a Fiber Bragg Grating (FBG) for temperature compensation. Finite Element Method (FEM) modeling is used to analyze the sensor's refractive index and temperature response. The experiment shows that the SPR sensor has excellent performance and is suitable for various dual-parameter sensing applications.

IEEE PHOTONICS JOURNAL (2022)

Article Optics

Thermally robust and highly stable method for splicing silica glass fiber to crystalline sapphire fiber

Farhan Mumtaz, Dinesh Reddy Alla, Muhammad Roman, Bohong Zhang, Jeffrey D. Smith, Rex E. Gerald II, Ronald J. O'Malley, Jie Huang

Summary: This research presents an innovative technique that joins silica glass fiber and sapphire single-crystal optical fiber, with the splice demonstrating thermal stability up to 1000 degrees C. A strong and durable splice was achieved using a filament heating process. A femtosecond laser was utilized to create a fiber Bragg gratings sensor in the sapphire single-crystal optical fiber, enabling measurement of high-temperature capabilities and signal attenuation characteristics of the splice joint. The experimental results confirm that the proposed splicing method produces a reliable and stable splice joint that can withstand temperatures up to 1000 degrees C, with only 0.5 dB of signal attenuation. This method allows for the integration of sapphire single-crystal fiber-based sensors in extreme environments encountered in various engineering sectors, leading to enhanced process monitoring, product quality, and production efficiency.

APPLIED OPTICS (2023)

Article Engineering, Electrical & Electronic

Temperature Monitoring in the Refractory Lining of a Continuous Casting Tundish Using Distributed Optical Fiber Sensors

Muhammad Roman, Hanok Tekle, Dinesh Reddy Alla, Farhan Mumtaz, Jeffrey D. Smith, Laura Bartlett, Ronald J. O'Malley, Rex E. Gerald, Jie Huang

Summary: This article explores the prospects of using spatially distributed optical fiber temperature sensors based on Rayleigh OFDR technology in the continuous casting of molten steel. The measurement capability of the optical fiber sensors in a simulated steelmaking environment was demonstrated. The embedded optical fiber sensors were used to measure the temperature distribution in the castable lining during the preheating process of the tundish and during its contact with molten steel.

IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT (2023)

Article Optics

Numerical analysis of the highly non-linear and ultra-sensitive modified core of a photonic crystal fiber sensor for detection of liquid analytes

Farhan Mumtaz, Ghulam Yaseen, Muhammad Roman, Lashari Ghulam Abbas, Muhammad Aqueel Ashraf, Muhammad Arshad Fiaz, Yutang Dai

Summary: A highly non-linear and ultra-sensitive modified core design of a photonic crystal fiber (PCF) sensor is presented for the detection of liquid analytes. The PCF sensor exhibits high relative sensitivity, strong non-linearity, low confinement loss, and operates in a wide wavelength range. It is a simple design that can be fabricated using existing manufacturing technologies.

JOURNAL OF THE OPTICAL SOCIETY OF AMERICA B-OPTICAL PHYSICS (2023)

Article Nanoscience & Nanotechnology

MXene (Ti3C2Tx) coated highly-sensitive D-shaped photonic crystal fiber based SPR-biosensor

Farhan Mumtaz, Muhammad Roman, Bohong Zhang, Lashari Ghulam Abbas, Yutang Dai, Muhammad Aqueel Ashraf, Muhammad Arshad Fiaz, Amit Kumar

Summary: This paper reports a D-shaped surface plasmon resonance (SPR) refractive index (RI) based biosensor for the earlier detection of various bio-analytes. The D-shaped photonic crystal fiber (PCF) lattice provides an improved cladding pattern for interacting with different bio-analytes. The introduction of a nanoscale MXene layer greatly enhances the sensitivity and performance of the sensor. The proposed SPR sensor exhibits high RI sensitivity and detection resolution, and can detect a wide range of bio-analytes.

PHOTONICS AND NANOSTRUCTURES-FUNDAMENTALS AND APPLICATIONS (2022)

Article Materials Science, Multidisciplinary

Micromachining of SiO2 single crystal wafer using femtosecond laser

You Wang, Farhan Mumtaz, Yutang Dai

Summary: This research presents the precise micromachining of silicon dioxide wafers using femtosecond laser. A prediction model for groove processing size is developed and an experiment is conducted to investigate the silicon dioxide groove processing technology. The effects of processing parameters on the processed properties of grooves, heat affected zone, and processed roughness are discussed. A variable defocus processing method is proposed to improve the inclination angle of the groove wall and the quality of the machined groove. Scanning electron microscopy is used for groove morphology analysis, allowing for surface quality improvement and processing parameter optimization.

JOURNAL OF LASER APPLICATIONS (2023)

Article Materials Science, Multidisciplinary

Hydrogen gas sensor based on seven-core fiber interference and Pt-WO3 film

You Wang, Farhan Mumtaz, Yutang Dai

Summary: Tungsten oxide (WO3) possesses electrochemical, photo-chromic, and gas-chromic characteristics. The seven-core fiber (SCF) generates an interference signal with super-modes. Utilizing the thermo-optic and thermo-expansion characteristics of SCF with the aid of a Pt-WO3 film, the sensor has high sensitivity to the H2 gas environment. The use of spiral micro grooves created by femtosecond-laser ablation significantly enhances H2 sensitivity and achieves a response and recovery time of less than 90 s.

MATERIALS LETTERS (2023)

Article Optics

Large-scale cascading of first-order FBG array in a highly multimode coreless fiber using femtosecond laser for distributed thermal sensing

Farhan Mumtaz, Bohong Zhang, Ronald j. O'malley, Jie Huang

Summary: This research focuses on the performance analysis and characterization of a fiber Bragg gratings (FBGs) array inscribed by a femtosecond laser in a highly multimode coreless fiber. The study evaluates the array's ability to function as a distributed thermal sensing platform and shows its high temperature sensitivity and stability.

OPTICS EXPRESS (2023)

Article Optics

Highly cascaded first-order sapphire optical fiber Bragg gratings fabricated by a femtosecond laser

Farhan Mumtaz, Hanok Tekle, Bohong Zhang, Jeffrey d. Smith, Ronald j. O'malley, Jie Huang

Summary: This study reports the fabrication of large-scale, highly cascaded first-order sapphire optical fiber Bragg gratings (FBGs) using a femtosecond laser-assisted point-by-point inscription method. For the first time, a distributed array of 10 FBGs within highly multimode sapphire crystal fiber is demonstrated, enabled by employing a high power laser technique. These first-order FBGs offer advantages such as enhanced reflectivity, shorter fabrication time, and simplified spectral characteristics, making them easier to interpret compared with high-order FBGs.

OPTICS LETTERS (2023)

Article Computer Science, Information Systems

Opposition-Based Quantum Bat Algorithm to Eliminate Lower-Order Harmonics of Multilevel Inverters

Jahedul Islam, Sheikh Tanzim Meraj, Ammar Masaoud, Md. Apel Mahmud, Amril Nazir, Muhammad Ashad Kabir, Md. Moinul Hossain, Farhan Mumtaz

Summary: This study proposes an opposition-based quantum bat algorithm (OQBA) to determine the optimum switching angles for multilevel inverters (MLI), formulated by utilizing the habitual characteristics of bats. The algorithm has advanced learning ability to effectively remove lower-order harmonics from the output voltage of MLI, ultimately improving the output voltage quality and MLI efficiency. The algorithm's performance is evaluated through three different case studies involving 7, 11, and 17-level three-phase MLIs, showing substantial improvement and superiority compared to other available algorithms in harmonics reduction and finding correct solutions.

IEEE ACCESS (2021)

No Data Available