The ICSD was founded as Comité International des Sports des Sourds (CISS) in Paris, France in August 1924, and was the first international organization in the world for athletes with disabilities.

The Executive Board consists of one President, one Vice-President and four member at large. There are four represents in a non-voting capacity who are elected for a term of four years by the Congress held every four years.

The ICSD is recognized by the International Olympic Committee (IOC), and has the patronage of the IOC each year to support promoting the Games worldwide. There are currently 95 member countries and split among 4 Continental Deaf Sports Confederations in Europe, Asia Pacific, Pan America and Africa. Chinese Taipei became an affiliated member country of Asia Pacific Deaf Sports Confederation in 1991.