2025 USA-NA-AIO Round 1, Problem 2, Part 7

Part 7 (5 points, non-coding task)

This question follows Part 6.

Denote by \mathbf{W} \in \Bbb R^{hidden\_features \times input\_features} the transformation matrix from the input layer to the hidden layer.

Given input \mathbf{x} \in \Bbb R^{input\_features}, write down the formula of the output \mathbf{y} and its shape.

  • Reasoning is not required.

\color{green}{\text{### WRITE YOUR SOLUTION HERE ###}}

\begin{align*} \mathbf{y} & = \mathbf{W}^\top \mathbf{W} \mathbf{x} \\ & \in \Bbb R^{input_features} . \end{align*}

\color{red}{\text{""" END OF THIS PART """}}