Growth of the bee skep(I'm assuming growth=worker bee amount for you) has nothing to do with trees or bushes or whatever. It is just the presence and survival of a queen and drones over time.
Bee skeps pollinate fruit trees the same as a butterfly conservatory. The difference is bee skeps do a better job with shorter range. While conservatories do a worse job at a larger range.