How Many Tokens Do 3D Point Cloud Transformer Architectures Really Need?