Yes. A section of multilayer ceramic capacitors is as a picture shown below. Changing it to an equivalent circuit, resistance and inductance of internal electrodes are connected in parallel.
Therefore, as the number of layers increase, the number of resistance and inductance connected in parallel also increase. This results in reduction of ESR and ESL.
Generally, as the size of a component is larger, the length of the internal electrodes becomes longer. Thus the resistance and inductance per an internal electrode become larger. In case that the size of a component is large, its ESR and/or ESL may be higher than the one with small size and a few of layers though the number of its layers is many.