Rubin, who had been in the role for five years, was previously chairman at Pentland Brands, Pentland Group’s portfolio of sports and fashion brands.
Pentland Group owns a 51.9% stake in JD Sports.
Rubin has been replaced by Andy Long. Long will continue as an executive director at Pentland Group, after stepping down as CEO of Pentland Brands at the end of 2020. He had previously been CFO and COO at Pentland Brands.
Prior to joining Pentland, Long held senior finance roles at Boots and Procter & Gamble, he has been a board member at Sport England since 2016.
Peter Cowgill, executive chairman at JD Sports, said: “I would like to thank Andy Rubin for his valuable contribution to the board over the last five years at JD, which has been a period of substantial growth of the group in geographic reach, turnover and profitability.
“I would also like to welcome Andy Long to the board of JD. His varied experience both at Pentland and elsewhere will be a great addition to our Board, as we continue our successful development.”