o Me@sdZddlZddlmmZddlmZddl m Z ddl m Z dZGdddejjejZd d Zd d Zd dZddZddZddZdS)z&Keras utilities for DTensor unit test.N) parameterized)api)contextcs<eZdZdZefddZfddZeddZZ S)DTensorBaseTestz8Provides comparison helper for dtensor vs local results.cstt|dSN)superr setUpClass)cls __class__GD:\Projects\ConvertPro\env\Lib\site-packages\keras/dtensor/test_util.pyr szDTensorBaseTest.setUpClasscstttdSr)rtearDownrZ async_wait reset_dtensor)selfr r rr#s  zDTensorBaseTest.tearDowncshtfdd}d}tjdr |d}tdt|n|d}tdt|t |S)aConfigs corresponding mesh given test context. If runs on a CPU mesh, set virtual device on CPU. If runs on a GPU mesh, sets virtual device on GPU with proper memory limits. if runs on a TPU mesh, initializes TPU system. Args: device_type_mesh_map: A dictionary containing device_type -> mesh mapping. Returns: A properly configured mesh for use in test. cs2|d}|dur|}td|d|d|S)Nz Requires a z mesh to run test on .)get ValueError) device_typemeshdtdevice_type_mesh_mapr rget_mesh>s z0DTensorBaseTest.configTestMesh..get_meshNGPUCPU) reset_contexttfconfiglist_physical_devicesreset_logical_devicesnpprodshaperZensure_initialized)rrrr rrconfigTestMesh,s  zDTensorBaseTest.configTestMesh) __name__ __module__ __qualname____doc__ classmethodr r staticmethodr% __classcell__r r r rrs  rcs,t|}tfddt|D|S)Ncsg|] }tjd|dqS)zlocalhost/replica:0/task:0)ZjobrZ device_index)rZ DeviceSpec).0irr r Tsz'create_device_array..)r"r#Zasarrayrangereshape)r$r device_countr r/rcreate_device_arrayQs   r4cCst||}t|Sr)r4r"Zraveltolist)r$rdevicesr r rcreate_device_list_s r7cCst|}t||Sr)r"r#Zaranger2)r$r3r r rcreate_device_ids_arrayds r8cC tdSr)rZ_reset_contextr r r rri rcCsttj|}|dkr tj|dtjg|dS|dkr9tj|dtjjtdg|dS|}td|)aVResets logical devices for CPU/GPU. Logical devices can only be instantiated once on a particular context. For now, context re-use is triggering some function duplication errors, so we reset the context on each call. Args: device_type: The device_type to reset. count: numbers of virtual device to reset to. rrr)Z memory_limitz8resetting logical device for non-supported device type: N) rrrr upperZ set_logical_device_configurationZLogicalDeviceConfiguration_DEFAULT_GPU_MEMORY_LIMITr)rcountr6rr r rr!ms0    r!cCr9r) dtensor_api_resetr r r rrr:r)r)numpyr"Ztensorflow.compat.v2compatv2rZ absl.testingrZtensorflow.dtensor.pythonrr>Ztensorflow.python.eagerrr<testZTestCaserr4r7r8rr!rr r r rs   5 &