Setup.
∬D(x2+y2)dxdy=∫01(∫01−x(x2+y2)dy)dx.
Integration in y.
∫01−x(x2+y2)dy=x2(1−x)+3(1−x)3.
Integration in x.
∫01(x2(1−x)+3(1−x)3)dx=[3x3−4x4−12(1−x)4]01.
At x=1: 31−41−0=121. At x=0: 0−0−121=−121. Hence
∬D(x2+y2)dxdy=121−(−121)=61.
Remark. This is consistent with the area of the triangle (1/2) and the symmetry of the domain.