Thin-film magnetization controlled by optical helicity has been recently reported. Although circularly polarized light has spin angular momentum, helicity-dependent all-optical magnetization switching is mediated by the stochastic thermal process, such as magnetic circular dichroism, and the effect of photon spin angular momentum is considered to be a secondary role. Conversely, the inverse Faraday effect in ferromagnetic thin films and photon spin angular momentum injection into heavy metal thin films have been observed, which can induce torque on metallic thin-film magnets. In this study, we show photon spin angular momentum driven magnetization dynamics in bilayers of Co/(Pt, Au) thin films with various thicknesses. The heavy metal Pt, Au, and ferromagnetic Co layer thickness dependencies of photon spin angular momentum driven torques are discussed in terms of field-like torque owing to the inverse Faraday effect and spin-transfer torque caused by photon spin angular momentum injection into the heavy metal layer with details of optical and magnetic properties. This study provides a better understanding of photon spin angular momentum induced magnetization dynamics in metallic thin-film heterostructures for efficient photon-driven magnetization manipulation.