Nithin Srinivasan,RM. Kuppan Chetty,Oh Joo Ztat,Manju Mohan,A. Joshuva,



Railroad Track Inspection,Visual Perception,Mobile Robot,Image Processing,Image Analysis,


Railroad track inspection is essential to guarantee safe operation condition for the rails to travel on. Even though railway sector invests hefty costs, time and strong human workforce to ensure the performance and safety of the railroads, frequent accident occurs throughout the year due to poor visual inspection carried out by the human inspectors. The quality of inspection remains a question mark and deteriorates progressively when the experienced human inspectors are made to carry out the inspection all along the railroads exposing them to mental fatigue and other potential health hazards. Therefore, in this study, a simple method using visual perception and image processing techniques for the inspection of railroad track for anomalies is presented as an alternate solution to the traditional inspection system. An automated wheeled mobile robot is also prototyped to carry out the inspection on the railroads. This prototyped system uses a visual perception algorithm based on edge detection and feature extraction is developed in LabVIEW, which continuously records the images of the track; assesses and detects the railroad components such as loose bolts, bent boltsand surface cracks, which are very critical for rail safety. The performance of the proposed system is investigated in the laboratory conditions and results show high performance in the detection of railroad track anomalies.


I. A. Distante, M. Nitti, E. Stella, P. L. Mazzeo, and F. Marino, “Automatic method and system for infrastructure visual inspection,” International Patent N. WO2007/010473, owned by the Italian National Research Council. World Intellectual Property Organization (WIPO), January 25, 2007 (International FilingDate: July 17, 2006; Priority Data: RM2005A000381, July 18, 2005).
II. A. Raza Rizvi, P. Rauf Khan, S. Ahmad., “Crack Detection in Railway Track Using Image Processing”, International Journal of Advance Research Ideas and Innovations in Technology, Vol.: 3, Issue: 4, pp. 489-496, 2017.
III. E.Resendiz, J.M.Hart and N.Ahuja., “Automated Visual Inspection of Railroad Tracks”, IEEE transactions on Intelligent Transportation Systems, Volume.: 14, Issue:2, pp. 751-760, 2013.
IV. E.Resendiz., L.Molina., J.Hart, J.Edwards, S.Sawadisavi, N.Ahuja and C.Barkan, “Development of a machine vision system for inspection of railway track components”, in Proceedings of the 12th WCTR World Conference on Transport Research, Lisbon, Portugal, pp.3355, 2010.
V. G.L. Foresti and C.S. Regazzoni, “New Trends in Video Communications, processing and Understanding in Surveillance Applications”, Proc. International Conference on Image Processing, Vol. : 89, Issue : 10, pp .1355 – 1367, 2001.
VI. H. Berger, “Non-Destructive Testing of Railroad Rail”, Transportation Research Record, Vol.: 744, pp. 22-26, 1980.
VII. Innotrack, D4.4.1, “Rail Inspection Technologies”, Projcet no. TIP5-CT-2006-031415, Available at:
VIII. J.L. Rose, M.J. Avioli, P. Mudge and R. Sanderson, “Guidedwave inspection potential of defects in rail”, NDT&E International, Vol. : 37, pp153-161, 2004.
IX. K. Itoh, H. Tanaka and M. Seki, “Eye MovementAnalysis of Track Monitoring patterns of Night Train Operators :Effects of Geographic Knowledge and Fatigue”, in Proceedings of the IEA 2000/HFES Congress, pp. 360-363, 2000.
X. M. Karakose, O.Yaman, M. Baygin, K. Murat and E. Akin, “A New Computer Vision Based Method for Rail Track Detection and Fault Diagnosis in Railways”, International Journal of Mechanical Engineering and Robotics Research, Vol.:6, Issue:1, pp.22-27, 2017.
XI. M. Singh, S. Singh, J. Jaisal and J.Hempshall, “Autonomous Rail Track Inspection using Vision Based System”, IEEE International Conference on Computational Intelligence for Homeland Security and Personal Safety, pp. 56 – 59, 2006.
XII. M.P. Papaelias and M. Lugg, “Detection and evaluation of rail surface defectsusingalternatingcurrentfieldmeasurement techniques”, Proceedings of the IMechE Part F : Journal of Rail and Rapid Transit, Vol.: 226, Issue: 5, pp. 530–541, 2016.
XIII. NI IMAQ Vision Assistance Tutorial [Online] Available:
XIV. NI IMAQ Vision Manual [Online] Available :
XV. NI Labview IMAQ Vision Concept Manual [Online]. Available:
XVI. P. L. Mazzeo, M. Nitti, E. Stella and A. Distante, “Visual Recognition of FasteningBolts for Railroad Maintenance”, Pattern Recognition Letters, pp. 669 – 677, 2004.
XVII. P. Yarza, A. Amirola, “New Technologies Applied to railway Infrastructure Maintenance”, Meeting on Planning, Design, Construction and Equipment of Metropolitan Railways, Madrid, 2003.
XVIII. R. A. Khan, S. Islam and R. Biswas, “Automatic Detection of defective rail anchors”, in Proc. IEEE 17th Internal Conferences on Intelligent Transportation Systems, pp.1583-1588, 2014.
XIX. R.K. Verma, A.Jeewan, S.Jain and M.Vats, “Automatic Railway Track Inspection for early warning using Real time image processing with GPS”, International Journal on Recent and Innovation Trends in Computing and Communication., Vol.:3, Issue:10, pp. 5880 – 5883, 2015.
XX. S. B. Aher and D. P. Tiwari, “Railway Disasters in India: Causes, Effects and Management”, International Journal of Reviews and Research in Social Science., Vol.: 6, Issue: 2, pp. 122-130, 2018.
XXI. S. Kenderian, B.B. Djordjevic, D. Cerniglia and G. Garcia, “Dynamic railroad inspection using the laser-air hybrid ultrasonic technique”, Insight, Vol.:48, Issue: 6, pp. 336-341, 2006.
XXII. S. Sawadisavi, J. Edwards, E.Resendiz, J. Hart., C. Barkan and N. Ahuja., “Development of a machine vision system for inspection of railroad track”, in Proceedings of the American Railway Engineering Maintenance Way Association Annual Conference, 2009.
XXIII. Y. Li, J. Wilson, and G.Y. Tian, “Experiment and simulation study of 3D magnetic field sensing for magnetic flux leakage defect characterization”, NDT & E International, Vol.:40, Issue.: 2, pp. 179-184, 2007.
XXIV. Z. Liu, A.D. Koffman, B. C. Waltrip and Y. Wang, “Eddy Current Rail Inspection Using AC Bridge Techniques”, Journal of Research of the National Institute of Standards and Technology, Vol.:118, pp.140-149, 2013.

View Download