How can I turn a .png image into an array of rgb values? (Grayscale is fine as well)

I would like to create a program to play a game. To do this, I need to look at the screen and the only way I can think of is to turn a .png screenshot into an array of RGB values then analyze them. How can I do this? I am open to other ideas on how to look for certain pixle colors.