Nothing seemed out of the ordinary when long-time couple Paul Simon and Edie Brickell were seen holding hands in New Canaan, Conn., except for the fact they were attending a court appearance for their joint disorderly conduct arrests.

The pair were arrested this past Saturday after "an argument" got out of hand at their home in the affluent Connecticut community.

"Investigating officers gathered information and found probable cause to arrest," a police statement read. Paul and Edie were released from custody early Sunday morning.

In a statement sent to CNN by Edie's lawyer, the 48-year-old singer attempted to clear up some confusion about the incident, which allegedly involved shoving.

edie brickell

"I got my feelings hurt and I picked a fight with my husband," Edie said, adding, "The police called it disorderly. Thank God it's orderly now."

After leaving the Norwalk Superior Court on Monday, Paul insisted the couple were "fine" and shared, "We're going to see our son's baseball game this afternoon."

The duo's next court date is set for May 16.

Singer-songwriter Paul is best known for being one-half of the legendary duo Simon and Garfunkel who produced hits such as "Bridge Over Troubled Waters" and "Mrs. Robinson." The 72-year-old has also had a successful solo career for more than four decades.

Edie was a member of the 1980s rock group, Edie Brickell & New Bohemians, and has also recorded with her Grammy Award-winning husband of 22 years.