Click the keycap to edit it and click the currently active Template to choose the template you want (arrow key or coloured sparkle)

This will give you a blank key in the correct colours & setup, but you will still need to select the right icon - click “Search icons”

There’s a lot going on here (in order to support the multi-colour novelties) but the sparkles and arrows should jump out 😅