With the help of glebaty I was able to solve the problem. This is how I converted the 4 bytes into decimal values.
open FILE, "source.bin" or die $!;
while (( my $n = read $FILE, my $data, 4) != 0) {
my $hex = unpack( 'H+', $data );
my $decimal = hex($hex);
}
close FILE;