k)i W dZddlZddlZddlZddlZddlZddlmZddlmZddl m Z m Z m Z m Z ddlZddlmZddlmZmZddlmZdd lmZdd lmZdd lmZdd lmZdd lmZddl m!Z!ejDe#Z$dFdZ%de&ddfdZ'de(dede)fdZ*ejVfde&dede&fdZ,de(de&fdZ-dGde&de&fdZ.de&de/e&e&e&ffdZ0de1ddfdZ2de&de&de/e&e&ffd Z3ed!d"d#fd$ed%ede1de&de e f d&Z4de1d'e&d(e&de5fd)Z6ed!d#fd$ed*e ede&de e fd+Z7de&ddfd,Z8d-Z9de&de&fd.Z: dHd/e1d'e&de&d0e e&de5f d1Z;d/e1de&de5fd2Z< dGde&d0e e&de e1fd3Z=de&de e1fd4Z>d5e&de&fd6Z?d5e&de e1fd7Z@d8e&d$ede e&fd9ZAd:e1de e e(e(ffd;ZBd:e1de e e(e(ffd<ZCd:e1de e e(e(ffd=ZDd:e1de e e(e(ffd>ZEd:e1d?e(de e e(e(ffd@ZFde e&e)ffdAZGdBe1de e&e)ffdCZHdDe e&e)fddfdEZIy)Iz File I/O operations module. This module handles file upload, download, and management operations for both local filesystem and AWS S3 storage. N)datetime)Path)DictListOptionalTuple) ClientError)File UploadFile)Session)get_active_cdn)settings) APIException)MAX_UPLOAD_SIZE_MB) FileSizeUnits)generate_secure_idreturnc tjtjdtj dtjy#t $r1}dtjd|}tj|d}~wwxYw)z Create the main uploads directory if it doesn't exist. Raises: Exception: If directory creation fails. T)exist_okz0Uploads directory created or already exists at: z&Failed to create uploads directory at due to: N)osmakedirsr UPLOADS_DIRloggerinfo Exceptionerror)eerr_msgs V/var/www/html/hwPaymentPortal-be-dev/hw-payment-portal-api/src/apps/files/helper/io.pycreate_uploads_directoryr! su H((48 FxG[G[F\]^ 4X5I5I4J)TUSV W   W sA A B,BBpathc tt|j}|jddtj d|y#t $r#}d|d|}tj|d}~wwxYw)z Create nested directory structure for file uploads. Args: path: The file path for which to create parent directories. Raises: Exception: If directory creation fails. T)parentsrz/Nested directory created or already exists at: z&Failed to create nested directory for rN)r!rparentmkdirrrrr)r" nested_pathrrs r create_nested_upload_directoryr(2st "4j'' $6 Ek]ST :4& !M W sA A A9A44A9 size_in_bytesunitctjdtjdtjdi}|j |d}||z S)z Convert file size from bytes to specified unit. Args: size_in_bytes: Size in bytes to convert. unit: Target unit for conversion. Returns: Converted size as float. @)rKBMBGBget)r)r*conversion_factorsfactors r convert_filesizer6GsM $+,  # #D! ,F 6 !!filepathc tjjtjtj |}tjj |}t||}t|dr|jjnd}|d|S#t$r%}tjd|d|Yd}~yd}~wwxYw) z Get the physical size of a file on the local filesystem. Args: filepath: Relative path to the file. unit: Unit for size measurement. Returns: File size as formatted string with unit. r*valuemb.2fzError getting file size for : N0kb)rr"joingetcwdrrgetsizer6hasattrr;lowerrrr)r8r* file_pathsizeconverted_size unit_suffixrs r get_physical_filesizerI\sGGLLh.B.BHM wwy))$T:,3D',Bdjj&&(  %k]33  3H:RsCDsBB C 'CC rFc`|dkr|dS|dkr |dz ddS|dkr |dz ddS|dz ddS) z Format file size with appropriate unit. Args: size: Size in bytes. Returns: Formatted size string with appropriate unit. r,z bytesr-r=z KBr.z MBz GB)rFs r _format_file_sizerLrse d{v t)C$$ " " "3's++',C00r7c |r*|jjdk(r t|}n t|}|syt t |S#t $r%}tjd|d|Yd}~yd}~wwxYw)z Get approximate file size by downloading and measuring content. Args: filepath: Path to the file. active_cdn: Active CDN configuration. Returns: Formatted file size string. s3r"z0 bytesz(Error getting approximate file size for r>N) labelrDdownload_file_from_s3download_file_from_system_pathrLlenrrr)r8 active_cdndownloaded_file_bytesrs r get_approximate_filesizerVsz  ***002d:$9x$H !$B$Q !$ %:!;<<  ?zA3OPs:AA A?A::A?original_filenamec|jdd}|jdd}t|dk(r|\}}n|dd}}tt j j }td }|d |d|}|||fS) z Generate a unique filename with timestamp and secure ID. Args: original_filename: Original filename from upload. Returns: Tuple of (unique_filename, basename, file_format).  -.r/rbinfile)prepend_)replacersplitrSintrutcnow timestampr)rW cleaned_name name_partsbasename file_formatsuffix unique_idunique_filenames r _generate_unique_filenamerms%,,S#6L$$S!,J :! *+ *1 u+HOO%//123F"62I" 1VHAk];O Hk 11r7contentschtdz}t||kDrttiddtdy)z Validate that file size doesn't exceed maximum allowed size. Args: contents: File content as bytes. Raises: APIException: If file size exceeds maximum allowed size. i@Bz#File exceeds maximum size limit of r<moduler status_codemessageN)rrSr__name__)rnmax_size_bytess r _validate_file_sizerwsC('1N 8}~%9:L9MRP   &r7filenamec|r |jn%tjtj}d||}||z}||fS)a  Determine upload and serve paths based on CDN configuration. Args: active_cdn: Active CDN configuration. path: Upload path prefix. filename: Generated filename. Returns: Tuple of (serve_path, upload_path). /) upload_pathrrArr)rTr"rx base_path serve_pathr{s r _determine_upload_pathsr~sT#-  }X112 3TF8*%Jj(K { ""r7.r7dbr^cBt|t|j\}}}|j}t |}t |||\} } t |||| } | sttiddtt|tj} |||| || dddS) a Upload a single file to configured storage (local or S3). Args: db: Database session. file: FastAPI UploadFile object. contents: File contents as bytes. path: Upload path prefix. Returns: Dictionary containing file metadata or None if upload fails. Raises: APIException: If file upload fails. rrpzCould not upload file.rqr:r=r<) file_name original_nameformatr" content_typefilesize) rwrmrxrr r~_perform_uploadrrur6rSrr1) rr^rnr"rrhrirrTr}r{uploaded file_size_mbs r upload_file_singlers*!'@'O$Ix$$L2&J5j$ RJ z8\;OH ,   $CM 8H8HIL!$#C(+  r7rr{cv|r+|jjdk(rt|||St||S)aI Perform the actual file upload based on CDN configuration. Args: active_cdn: Active CDN configuration. contents: File contents as bytes. content_type: MIME type of the file. upload_path: Full upload path. Returns: True if upload successful, False otherwise. rN) file_contentrr")rr")rPrDupload_file_to_s3upload_file_to_system_path)rTrnrr{s r rrsBj&&,,.$6 !%  *xkRRr7filescg}|D]F}|jj}t|t||||}|j |H|S)a` Upload multiple files to configured storage. Args: db: Database session. files: List of FastAPI UploadFile objects. path: Upload path prefix. Returns: List of dictionaries containing file metadata. Raises: APIException: If any file upload fails or exceeds size limit. )r^readrwrappend)rrr"uploaded_filesr^rn uploaded_files r upload_file_multipler-sV&N-99>>#H%*2tXtD m, - r7c tj|tjd|y#t$rtj d|Yyt $r%}tjd|d|Yd}~yd}~wwxYw)zw Remove a single file from the local filesystem. Args: path: Full path to the file to remove. zSuccessfully removed file: zFile not found for removal: zFailed to remove file r>N)runlinkrrFileNotFoundErrorwarningrr)r"rs r remove_file_singlerLso; $ 1$89 >5dV<= ; -dV2aS9::;s-0!BBA;;BcltjdtjtjdS)ze Create and return configured S3 client. Returns: Boto3 S3 client instance. rNz us-east-1) service_nameaws_access_key_idaws_secret_access_key region_name)boto3clientrAWS_S3_ACCESS_KEYAWS_S3_SECRET_KEYrKr7r _create_s3_clientr\s- <<"44&88  r7c2|jdr|ddS|S)z Remove leading slash from S3 path if present. Args: path: Original path. Returns: Sanitized path without leading slash. rzr/N) startswithrOs r _sanitize_s3_pathrks s+4855r7rbucketc|tj} t}t|}|j t j |||d|itjd|y#t$r"}tjd|Yd}~yd}~wt$r"}tjd|Yd}~yd}~wwxYw) aC Upload a file to AWS S3 bucket. Args: file_content: File content as bytes. content_type: MIME type of the file. path: S3 object key/path. bucket: S3 bucket name. If None, uses default from settings. Returns: True if upload successful, False otherwise. N ContentType)FileobjBucketKey ExtraArgsz"Successfully uploaded file to S3: TzAWS S3 upload error: Fz#Unexpected error during S3 upload: ) rAWS_S3_DEFAULT_BUCKETrrupload_fileobjioBytesIOrrr rr)rrr"r s3_clientsanitized_pathrs r rrxs$~//%' *40  JJ|,$l3 !   88HIJ  ,QC01  :1#>?s$AA,, C5B CB;;Cc: tjd||r t|t|d5}|j |dddtjdy#1swYxYw#t $r"}tj d|Yd}~yd}~wwxYw)z Upload a file to the local filesystem. Args: file_content: File content as bytes. path: Full filesystem path where file should be saved. Returns: True if upload successful, False otherwise. zAttempting to upload to path: wbNz.File uploaded successfully to local filesystemTzLocal file upload error: F)rrr(openwriterr)rr"frs r rrs  4TF;<  *4 0 $  " GGL ! "  DE  " "  045s.1A/A#A/#A,(A// B8BBcR t}t|}|tj}t j }|j |||tjd||jS#t$r%}tjd|d|Yd}~yd}~wwxYw)z Download a file from AWS S3 bucket. Args: path: S3 object key/path. bucket: S3 bucket name. Returns: File content as bytes, or None if download fails. Nz&Successfully downloaded file from S3: zCould not fetch file from S3 r>) rrrrrrdownload_fileobjrrgetvaluerr)r"rrrbufferrs r rQrQs%' *40 >33F""6>6B <^)rrrrrrr)r"rdatars r rRrRs  $  668D   DTFKL     )$01  =dV2aSIJs3 A A!A A A !B0B8BB image_pathc|}|j|j|jfD]}|s||vs |j|d}|S)z Clean image path by removing CDN-specific prefixes. Args: image_path: Original image path. active_cdn: Active CDN configuration. Returns: Cleaned image path. r)hostrootr"ra)rrT cleaned_path path_prefixs r _clean_image_pathrsQL"*//JA ;,6'// R@LA r7c|j|}|jjdk(r t|St |S)z Download image content based on CDN configuration. Args: active_cdn: Active CDN configuration. image_path: Path to the image. Returns: Image content as bytes, or None if download fails. rNrO)r{rPrDrQrR)rTr full_paths r _download_image_contentrsF))*:,7I4'$)44-9==r7 image_urlct|}|s|St||}t||}|s%tj d|j |yt j|jd}d|S)z Convert an image URL to base64 encoded string. Args: image_url: URL or path to the image. db: Database session. Returns: Base64 encoded image string with data URI prefix, or None if conversion fails. rzNo content found at: Nzutf-8zdata:image/png;base64,) r rrrrr{base64 b64encodedecode)rrrTrrU b64_encodeds r get_b64_imagers~ 2&J "9j9J3J K .z/E/E.FzlST""#89@@IK #K= 11r7 image_contentcv t|S#t$r"}tjd|Yd}~yd}~wwxYw)a3 Extract image resolution (width, height) from image content. Supports PNG and JPEG image formats by parsing their binary headers. Args: image_content: Raw bytes of the image file. Returns: Tuple of (width, height) in pixels, or None if parsing fails. z&Error while parsing image resolution: N)_parse_image_resolutionrrr)rrs r get_image_resolutionr5s9&}55  =aSABs 838cnt|dkry|dddk(r t|S|dddk(r t|Sy)z Parse image resolution from binary content for supported formats. Args: image_content: Raw bytes of the image file. Returns: Tuple of (width, height) in pixels, or None if format not supported. NsPNG  r\s)rS_parse_png_resolution_parse_jpeg_resolution)rs r rrHsP =BRa00$]33 r k )%m44 r7c`t|dkrytjd|dd\}}||fS)z Parse PNG image resolution from IHDR chunk. Args: image_content: PNG image bytes. Returns: Tuple of (width, height) in pixels. rNz>II)rSstructunpack)rwidthheights r rr`s; =BMM%r")=>ME6 &=r7c d}|t|dz krq||dk7r y ||dz}|dvr t||S|dzt|k\r y tjd||dz|dzd }|d|zz }|t|dz krqy ) z Parse JPEG image resolution from SOF (Start of Frame) marker. Args: image_content: JPEG image bytes. Returns: Tuple of (width, height) in pixels, or None if SOF not found. r\ r/)z>HrN)rS_extract_jpeg_dimensionsrr)rindexmarkerlengths r rrrs E #m$q( (  4 '  uqy) - -+M5A A 19M* *  t]519UQY%GHK V! #m$q( ($ r7 sof_indexc tjd||dz|dz\}}}||fS#tjtf$rYywxYw)z Extract dimensions from JPEG SOF marker. Args: image_content: JPEG image bytes. sof_index: Index of the SOF marker. Returns: Tuple of (width, height) in pixels. z>HHHrrN)rrr IndexError)rrr`rrs r rrsW!== M)a- A > 65f} LL* %s&)AAc >d}d}|D]{}t|dr t|dstjd1|j}|s$tj dt |ddct ||}||dz }|dz }}||d z |d z |d }t||S) a^ Calculate and log sizes of email attachments. Processes a collection of mail attachments and calculates their individual and total sizes in bytes, KB, and MB. Logs detailed size information. Args: mail_attachments: Collection of attachment objects with 'byte_content' and 'original_name' attributes. Returns: Dictionary containing total size statistics with keys: - 'total_bytes': Total size in bytes - 'total_kb': Total size in kilobytes - 'total_mb': Total size in megabytes r byte_contentrzDAttachment missing required attributes (byte_content, original_name)zEmpty attachment: Unknownbytesr/r,r-) total_bytestotal_kbtotal_mbattachment_count)rCrrrrgetattr%_calculate_individual_attachment_size_log_total_attachment_sizes)mail_attachmentstotal_size_bytesr attachmentr size_info total_statss r calculate_attachment_sizesrs"&  z>2'*o:^ NNa b !..  KK,WZR[-\,]^ _ 9*lS Ig..A  ($t+$ 4, K , r7rc t|}|dz }|dz }|||d}tjd|jd|d|dd|dd |S) a Calculate size metrics for a single attachment. Args: attachment: Attachment object with original_name attribute. byte_content: Raw bytes of the attachment. Returns: Dictionary with size metrics in different units. r,)rkbr<z Attachment: z - Size:  bytes (r= KB,  MB))rSrrr)rr size_bytessize_kbsize_mbrs r rrsy\"J4GnGI  KK z//01 HWSMwsm4 I r7rc dtjd|dd|dd|ddd|d dd y ) z Log total attachment size statistics. Args: total_stats: Dictionary containing total size statistics. zTotal Attachments (rz files) - Size: rrrr=rrrN)rr)rs r rrsV KK k*<=>?]+,-  #C (k*.Ec-J$ Pr7)rN)N)rN)J__doc__rrloggingrrrpathlibrtypingrrrrrbotocore.exceptionsr fastapir r sqlalchemy.ormr src.apps.base.servicesr src.core.configrsrc.core.exceptionsrsrc.core.utils.constantsrsrc.core.utils.enumsrsrc.apps.base.utils.functionsr getLoggerrurr!strr(rcfloatr6r1rIrLrVtuplermrrwr~rboolrrrrrrrrQrRrrrrrrrrrrrrKr7r rs  .. +$"1$,7.<   8 $$*"C"}""*@M?O?OC}TW,1C1C1(s422sC}9M22 % D (#c#S#U3PS8_#0Cy 00 00  0 d^ 0fS%SsSQTSY]S2#3i    $Z > ;S ;T ;  6C 6C 6  ''' ' SM '  'TU#$:!  SMe_>%0#c(>C>HUO>&2S2g2(3-24(5c?2K&5XeCHo5N08E#s(O3L$%HU38_4MBEchuUXZ]U]F_*+De4D+\EdSVX]S]N^: T#u*-= $ r7