This is normal. The standard operating temperature is 86 to 122°F (30 to 50°C). The adapter is bus-powered and has active chipsets that power on when it is connected, so it warms up even when nothing is plugged into its ports. This will not affect performance or damage the hardware.