\[ \int (a+a \cos (c+d x))^2 (A+B \cos (c+d x)) \sqrt {\sec (c+d x)} \, dx \]
Optimal antiderivative \[ \frac {2 B \left (a^{2}+a^{2} \sec \left (d x +c \right )\right ) \sin \left (d x +c \right )}{5 d \sec \left (d x +c \right )^{\frac {3}{2}}}+\frac {2 a^{2} \left (5 A +7 B \right ) \sin \left (d x +c \right )}{15 d \sqrt {\sec \left (d x +c \right )}}+\frac {4 a^{2} \left (5 A +4 B \right ) \sqrt {\frac {\cos \left (d x +c \right )}{2}+\frac {1}{2}}\, \EllipticE \left (\sin \left (\frac {d x}{2}+\frac {c}{2}\right ), \sqrt {2}\right ) \left (\sqrt {\cos }\left (d x +c \right )\right ) \left (\sqrt {\sec }\left (d x +c \right )\right )}{5 \cos \left (\frac {d x}{2}+\frac {c}{2}\right ) d}+\frac {4 a^{2} \left (2 A +B \right ) \sqrt {\frac {\cos \left (d x +c \right )}{2}+\frac {1}{2}}\, \EllipticF \left (\sin \left (\frac {d x}{2}+\frac {c}{2}\right ), \sqrt {2}\right ) \left (\sqrt {\cos }\left (d x +c \right )\right ) \left (\sqrt {\sec }\left (d x +c \right )\right )}{3 \cos \left (\frac {d x}{2}+\frac {c}{2}\right ) d} \]
command
integrate((a+a*cos(d*x+c))^2*(A+B*cos(d*x+c))*sec(d*x+c)^(1/2),x, algorithm="fricas")
Fricas 1.3.8 (sbcl 2.2.11.debian) via sagemath 9.6 output
\[ -\frac {2 \, {\left (5 i \, \sqrt {2} {\left (2 \, A + B\right )} a^{2} {\rm weierstrassPInverse}\left (-4, 0, \cos \left (d x + c\right ) + i \, \sin \left (d x + c\right )\right ) - 5 i \, \sqrt {2} {\left (2 \, A + B\right )} a^{2} {\rm weierstrassPInverse}\left (-4, 0, \cos \left (d x + c\right ) - i \, \sin \left (d x + c\right )\right ) - 3 i \, \sqrt {2} {\left (5 \, A + 4 \, B\right )} a^{2} {\rm weierstrassZeta}\left (-4, 0, {\rm weierstrassPInverse}\left (-4, 0, \cos \left (d x + c\right ) + i \, \sin \left (d x + c\right )\right )\right ) + 3 i \, \sqrt {2} {\left (5 \, A + 4 \, B\right )} a^{2} {\rm weierstrassZeta}\left (-4, 0, {\rm weierstrassPInverse}\left (-4, 0, \cos \left (d x + c\right ) - i \, \sin \left (d x + c\right )\right )\right ) - \frac {{\left (3 \, B a^{2} \cos \left (d x + c\right )^{2} + 5 \, {\left (A + 2 \, B\right )} a^{2} \cos \left (d x + c\right )\right )} \sin \left (d x + c\right )}{\sqrt {\cos \left (d x + c\right )}}\right )}}{15 \, d} \]
Fricas 1.3.7 via sagemath 9.3 output
\[ {\rm integral}\left ({\left (B a^{2} \cos \left (d x + c\right )^{3} + {\left (A + 2 \, B\right )} a^{2} \cos \left (d x + c\right )^{2} + {\left (2 \, A + B\right )} a^{2} \cos \left (d x + c\right ) + A a^{2}\right )} \sqrt {\sec \left (d x + c\right )}, x\right ) \]