Driver Abdul Malek alias Badal of Directorate General of Health Services (DGHS) has been suspended.
DGHS DG Dr Abul Bashar Mohammad Khurshid Alam confirmed the matter to media on Monday afternoon.
Earlier on the day, a Dhaka court placed the driver on a 14-day remand in two separate cases filed under the Arms and the Special Powers Acts.
On Sunday, RAB arrested Malek from Kamarpara area under Turag police station in Dhaka with a foreign made pistol, a magazine, five bullets, and counterfeit notes worth Tk1.50 lakh.
A third class employee, Malek accumulated wealth of crores of taka by resorting to illegal means, RAB said.
According to the primary investigation of the battalion, Malek was allegedly involved in trading illegal firearms and fake currencies, extortion and other criminal activities in Turag area.