D-FINE-seg – detection, instance and semantic segmentation in one model (github.com)

D-FINE-seg has been unveiled as an innovative framework that combines real-time object detection, instance segmentation, and semantic segmentation within a single codebase. By incorporating a streamlined workflow—from dataset preparation to multi-backend inference—this model offers five different sizes and allows for seamless deployment across various platforms like ONNX, TensorRT, and CoreML. Notably, D-FINE-seg outperforms leading models like YOLO26 and RF-DETR in both detection and segmentation tasks, achieving competitive accuracy metrics on benchmarks such as Cityscapes while utilizing 2-3 times fewer parameters. The significance of D-FINE-seg lies in its efficient architecture and advanced training methodology, which includes features like mask-aware training, multi-channel inputs, and integrated tracking capabilities via ByteTrack. The model supports various input types beyond traditional RGB, such as thermal and depth data, further enhancing its applicability in complex environments. Developers benefit from the convenience of pre-trained weights that auto-download, along with extensive support for both YOLO and COCO annotation formats. This framework not only streamlines the object detection pipeline but also enriches it with robust functionality, paving the way for more sophisticated applications in AI/ML.