What's the difference between colored aluminum and coated aluminum foil?
According to your description, I suggest you adopt acid pickling process. The basic principle is that aluminum foil will conduct oxidation reaction after being put into the acid to change the color of aluminum foil, which will meet your requirement. The color belongs to aluminum itself not painted by people! This method can get many colors like golden and milky. Different acid ratio will lead to different color.