Hi Eli,
Some BACnet equipment is just very slow at responding. Are you only communicating with one peer? If not you might try parallelizing your requests by wrapping your calls in functions and running them concurrently.
Even if you're only talking to one peer, this might still be possible but some hardware i know of will only service a single request at a time, so it may not help.