ABSTRACT
The impact of marine life on the oceans of our planet is undeniable and overfishing is a serious threat to marine ecosystems worldwide. Maritime domain awareness calls for continuous monitoring and tracking of fisheries using data from maritime intelligence sources to detect illegal fishing activities. Marine traffic data from vessel tracking services is a promising source for identifying, locating, and capturing vessel information. Given the volume of such data, manual processing is impossible, raising an immediate need for autonomous and smart systems to follow the footprints of vessels and detect their activity types in near real-time. To achieve this goal, we propose FishNET, a simple yet effective convolutional neural network (CNN) model for vessel trajectory classification. The model is trained using a set of invariant spatiotemporal feature sequences extracted from the behavioral characteristics of vessel movements.
While existing approaches present point-based classification models, in this paper we not only discuss that a segment-based classification model has more realistic real-world applications but also show, by using expert-labelled data, that FishNET outperforms state-of-the-art fishing activity detection models. Our method does not require information about the fishing vessels type or type of fishing gear which is deployed.
To show applications in taking action against illegal fishing, we apply the trained model on large real-world but unlabelled fishing vessel data from the U.S. and Denmark gathered over a period of four years. In this analysis, we show how FishNET can contribute to managing fisheries by learning more about spatiotemporal fishing effort distribution, and to law enforcement agencies by detecting unreported and underreported fishing effort of individual vessels.
- D. Pauly and D. Zeller, "Comments on faos state of world fisheries and aquaculture (sofia 2016)," Marine Policy, vol. 77, pp. 176--181, 2017.Google ScholarCross Ref
- "Illegal, Unreported and Unregulated (IUU) Fishing - International Fisheries." [Online]. Available: https://dfo-mpo.gc.ca/international/isu-iuu-eng.htmGoogle Scholar
- A. Shaver and S. Yozell, "Casting a wider net," The Stimson Center, January, 2018.Google Scholar
- T. N. P. Bondaroff, W. Werf, and T. Reitano, "The global initiative against transnational organized crime and the black fish," The Global Initiative Against Transnational Organized Crime, 2015, accessed: 2020-06-20.Google Scholar
- "Presidential task force on combating illegal, unreported, and unregulated fishing and seafood fraud. U.S. national oceanic and atmospheric administration (NOAA)," https://www.iuufishing.noaa.gov, 2018, Accessed: 2020-06-20.Google Scholar
- "Fisheries and Oceans Canada. Illegal, unreported and unregulated (IUU) fishing," http://www.dfo-mpo.gc.ca/international/isu-iuu-eng.htm, 2019, 2020-06-20.Google Scholar
- Food and Agriculture Organization of the United Nations, "The State of World Fisheries and Aquaculture 2018," http://www.fao.org/3/i9540en/I9540EN.pdf, 2018, Accessed: 2020-06-20.Google Scholar
- K. Cutlip, "IUU-illegal, unreported, unregulated fishing. Global fishing watch," http://globalfishingwatch.org/fisheries/iuu-illegal-unreported-unregulated-fishing, 2016, Accessed: 2020-06-20.Google Scholar
- Y. Ye and N. L. Gutierrez, "Ending fishery overexploitation by expanding from local successes to globalized solutions," Nature Ecology & Evolution, vol. 1, no. 7, p. 0179, 2017.Google ScholarCross Ref
- "Sustainability through transparency. Global fishing watch." [Online]. Available: https://globalfishingwatch.org/Google Scholar
- S.-K. Chang and T.-L. Yuan, "Deriving high-resolution spatiotemporal fishing effort of large-scale longline fishery from vessel monitoring system (vms) data and validated by observer data," Canadian Journal of Fisheries and Aquatic Sciences, vol. 71, no. 9, pp. 1363--1370, 2014.Google ScholarCross Ref
- H. Ljunggren, "Using deep learning for classifying ship trajectories," in 2018 21st International Conference on Information Fusion (FUSION). IEEE, 2018, pp. 2158--2164.Google Scholar
- J. Venskus, P. Treigys, J. Bernatavičiene, G. Tamulevičius, and V. Medvedev, "Real-time maritime traffic anomaly detection based on sensors and history data embedding," Sensors, vol. 19, no. 17, p. 3782, 2019.Google ScholarCross Ref
- D. Nguyen, R. Vadaine, G. Hajduch, R. Garello, and R. Fablet, "A multi-task deep learning architecture for maritime surveillance using ais data streams," in 2018 IEEE 5th International Conference on Data Science and Advanced Analytics (DSAA). IEEE, 2018, pp. 331--340.Google Scholar
- X. Jiang, D. L. Silver, B. Hu, E. N. de Souza, and S. Matwin, "Fishing activity detection from ais data using autoencoders," in Canadian Conference on Artificial Intelligence. Springer, 2016, pp. 33--39. Google ScholarDigital Library
- X. Jiang, E. N. de Souza, X. Liu, B. H. Soleimani, X. Wang, D. L. Silver, and S. Matwin, "Partition-wise recurrent neural networks for point-based ais trajectory classification." in ESANN, 2017.Google Scholar
- E. N. de Souza, K. Boerder, S. Matwin, and B. Worm, "Improving fishing pattern detection from satellite ais using data mining and machine learning," PloS one, vol. 11, no. 7, p. e0158248, 2016.Google ScholarCross Ref
- D. A. Kroodsma, J. Mayorga, T. Hochberg, N. A. Miller, K. Boerder, F. Ferretti, A. Wilson, B. Bergman, T. D. White, B. A. Block et al., "Tracking the global footprint of fisheries," Science, vol. 359, no. 6378, pp. 904--908, 2018.Google ScholarCross Ref
- "Automatic Identification Systems (AIS)," International Maritime Organization. [Online]. Available: https://www.imo.org/en/OurWork/Safety/Navigation/Pages/AIS.aspxGoogle Scholar
- "MarineTraffic - the most popular online service for vessel tracking | AIS Marine Traffic." [Online]. Available: https://www.marinetraffic.com/en/p/ais-station-operator-contest-2018Google Scholar
- J. N. Newman, "The theory of ship motions," in Advances in applied mechanics. Elsevier, 1979, vol. 18, pp. 221--283.Google Scholar
- M. McDonald, "SHF SATCOM terminal ship-motion study," Naval Command Control and Ocean Surveillance Center, San Diego, CA, Tech. Rep., 1993.Google Scholar
- G. Van Brummelen, Heavenly mathematics: The forgotten art of spherical trigonometry. Princeton University Press, 2012.Google Scholar
- S. Kiranyaz, T. Ince, O. Abdeljaber, O. Avci, and M. Gabbouj, "1-d convolutional neural networks for signal processing applications," in ICASSP 2019-2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). IEEE, 2019, pp. 8360--8364.Google Scholar
- J. Bouvrie, "Notes on convolutional neural networks," In Practice, pp. 47--60, 2006. [Online]. Available: http://cogprints.org/5869/Google Scholar
- N. Ellis and Y.-G. Wang, "Effects of fish density distribution and effort distribution on catchability," ICES Journal of Marine Science, vol. 64, no. 1, pp. 178--191, 2007.Google ScholarCross Ref
- C. T. Darimont, C. H. Fox, H. M. Bryan, and T. E. Reimchen, "The unique ecology of human predators," Science, vol. 349, no. 6250, pp. 858--860, 2015.Google ScholarCross Ref
- D. A. Goward, "Maritime domain awareness: The key to maritime security," Legal challenges in maritime security. Leiden: Martinus Nijhoff, 2008.Google Scholar
Recommendations
Classification of vessel activity in streaming data
DEBS '20: Proceedings of the 14th ACM International Conference on Distributed and Event-based SystemsIn this paper we motivate the need for real-time vessel behaviour classification and describe in detail our event-based classification approach, as implemented in our real-world industry strong maritime event detection service at MarineTraffic.com. A ...
Trajectory Data Mining: An Overview
Survey Paper, Regular Papers and Special Section on Participatory Sensing and Crowd IntelligenceThe advances in location-acquisition and mobile computing techniques have generated massive spatial trajectory data, which represent the mobility of a diversity of moving objects, such as people, vehicles, and animals. Many techniques have been proposed ...
The study of identification of fishing vessel behavior based on VMS data
ICTCE '19: Proceedings of the 3rd International Conference on Telecommunications and Communication EngineeringAccurate identification of different behaviours of fishing vessels is important for fisheries management and fisheries ecology, which can enhance the management of overfishing and marine resources. In this study we identify fishing vessel fishing ...
Comments