They arrived at the Bukit Mertajam courthouse in three police trucks at about 10.20am on Wednesday (July 21).
Among them were 48 Bangladeshis aged between 20 and 43 years who were remanded for four days.
A 64-year-old local man who was part of the group was remanded for three days.
Assistant court registrar Hasliza Razak granted the remand order.
On Tuesday, Penang police chief Comm Datuk Mohd Shuhaily Mohd Zain said the men allegedly performed Hari Raya Aidiladha prayers outside the surau.
It was reported that the group had gone to the surau for prayers on the morning of Hari Raya Haji but were denied entry as the limit of 100 people had been reached.
They then reportedly gathered to perform their prayers on the road in front of the surau, which is near the Taman Pelangi flats in Auto City, Juru.
Comm Mohd Shuhaily said despite the group appearing to practise physical distancing, police are tracking down about 200 of them to investigate the gathering under Section 269 of the Penal Code for a negligent act that could spread an infectious disease, as well as movement without permission; Section 270 of the Penal Code for spreading harmful infection; and the Prevention and Control of Infectious Diseases Act 1988 (Act 342) (Measures in Communicable Areas) Regulations 2020.