Solana address do not have a any specific starting value (like "0x" on Ethereum).
But like you pointed out, these addresses are base58 encoded version of a 32 byte array. Resulting in a specific string length between 32-44 characters long.
So if you wanted to perform some very simple validity format checks, you could use a regex like this:
[1-9A-HJ-NP-Za-km-z]{32,44}
Note that base58 strings will NOT use the entire regular English alphabet.
You can also read more about these on the Solana docs site here: https://docs.solana.com/integrations/exchange#basic-verfication