Generally backup and restore of FILESTREAM enabled database that too which has large number of FILESTREAM files will be slower than a backup or restore of an SQL Server database of an equivalent size. This happens because of the extra overhead of backing up each NTFS file and this overhead becomes move noticeable when the FILESTREAM files are very small in size (less than 1 MB).
May I know out of 320 GB, how much space is currently used for FILESTREAM data storage? And also let me know how many files are stored and there average size?
I am assuming that you have millions of FILESTREAM files and there could be many files which are of size below 1 MB. Ideally FILESTREAM should be used when you are storing file greater than 1 MB.
You can optimize NTFS performance by turning off the below two processes by running it within the command prompt.
FSUTIL BEHAVIOR SET DISABLE8DOT3 1
The above option disables the generation of 8.3 names on all NTFS volumes on the server where FILESTREAM Feature is configured.
FSUTIL BEHAVIOR SET DISABLELASTACCESS 1
The above option will turn off updating the last access time for a file when it is accessed.
Hope this helps!