dat
commited on
Commit
•
863f702
1
Parent(s):
c48cf13
update readme
Browse files- README.md +7 -1
- events.out.tfevents.1626474829.t1v-n-f5c06ea1-w-0.798495.3.v2 +2 -2
- wandb/run-20210716_223350-8eukt20m/files/output.log +320 -0
- wandb/run-20210716_223350-8eukt20m/files/wandb-summary.json +1 -1
- wandb/run-20210716_223350-8eukt20m/logs/debug-internal.log +644 -0
- wandb/run-20210716_223350-8eukt20m/run-8eukt20m.wandb +0 -0
README.md
CHANGED
@@ -7,7 +7,13 @@ datasets:
|
|
7 |
|
8 |
# Pino (BigBird) base model
|
9 |
|
10 |
-
Created by Dat Nguyen & Yeb Havinga
|
|
|
|
|
|
|
|
|
|
|
|
|
11 |
|
12 |
BigBird, is a sparse-attention based transformer which extends Transformer based models, such as BERT to much longer sequences. Moreover, BigBird comes along with a theoretical understanding of the capabilities of a complete transformer that the sparse model can handle.
|
13 |
|
|
|
7 |
|
8 |
# Pino (BigBird) base model
|
9 |
|
10 |
+
Created by [Dat Nguyen](https://www.linkedin.com/in/dat-nguyen-49a641138/) & Yeb Havinga during the [Hugging Face community week](https://discuss.huggingface.co/t/open-to-the-community-community-week-using-jax-flax-for-nlp-cv/7104)
|
11 |
+
|
12 |
+
|
13 |
+
|
14 |
+
Please do not hesitate to contact me via [LinkedIn](https://www.linkedin.com/in/henryk-borzymowski-0755a2167/=
|
15 |
+
|
16 |
+
|
17 |
|
18 |
BigBird, is a sparse-attention based transformer which extends Transformer based models, such as BERT to much longer sequences. Moreover, BigBird comes along with a theoretical understanding of the capabilities of a complete transformer that the sparse model can handle.
|
19 |
|
events.out.tfevents.1626474829.t1v-n-f5c06ea1-w-0.798495.3.v2
CHANGED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
-
size
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:2eba091f8fe3f0ead59825c7368f8ceef1e86032529a74117afab28db1b6b4d1
|
3 |
+
size 2128342
|
wandb/run-20210716_223350-8eukt20m/files/output.log
CHANGED
@@ -1831,3 +1831,323 @@ Training...: 11749it [1:24:42, 5.33it/s]█████████████
|
|
1831 |
|
1832 |
|
1833 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1831 |
|
1832 |
|
1833 |
|
1834 |
+
Training...: 11799it [1:24:58, 5.03it/s]█████████████████████████████████████████████████████████████████████████████████████████████████| 500/500 [01:17<00:00, 7.90it/s]
|
1835 |
+
|
1836 |
+
|
1837 |
+
|
1838 |
+
|
1839 |
+
|
1840 |
+
|
1841 |
+
Training...: 11849it [1:25:18, 5.39it/s]█████████████████████████████████████████████████████████████████████████████████████████████████| 500/500 [01:17<00:00, 7.90it/s]
|
1842 |
+
|
1843 |
+
|
1844 |
+
|
1845 |
+
|
1846 |
+
|
1847 |
+
|
1848 |
+
Training...: 11899it [1:25:38, 3.71it/s]█████████████████████████████████████████████████████████████████████████████████████████████████| 500/500 [01:17<00:00, 7.90it/s]
|
1849 |
+
|
1850 |
+
|
1851 |
+
|
1852 |
+
|
1853 |
+
|
1854 |
+
|
1855 |
+
Training...: 11949it [1:25:58, 5.69it/s]█████████████████████████████████████████████████████████████████████████████████████████████████| 500/500 [01:17<00:00, 7.90it/s]
|
1856 |
+
|
1857 |
+
|
1858 |
+
|
1859 |
+
|
1860 |
+
|
1861 |
+
Training...: 11999it [1:26:18, 5.52it/s]█████████████████████████████████████████████████████████████████████████████████████████████████| 500/500 [01:17<00:00, 7.90it/s]
|
1862 |
+
|
1863 |
+
|
1864 |
+
|
1865 |
+
|
1866 |
+
|
1867 |
+
|
1868 |
+
Training...: 12049it [1:26:38, 5.20it/s]█████████████████████████████████████████████████████████████████████████████████████████████████| 500/500 [01:17<00:00, 7.90it/s]
|
1869 |
+
|
1870 |
+
|
1871 |
+
|
1872 |
+
|
1873 |
+
|
1874 |
+
Training...: 12099it [1:26:58, 6.00it/s]█████████████████████████████████████████████████████████████████████████████████████████████████| 500/500 [01:17<00:00, 7.90it/s]
|
1875 |
+
|
1876 |
+
|
1877 |
+
|
1878 |
+
|
1879 |
+
|
1880 |
+
Training...: 12149it [1:27:18, 4.68it/s]█████████████████████████████████████████████████████████████████████████████████████████████████| 500/500 [01:17<00:00, 7.90it/s]
|
1881 |
+
|
1882 |
+
|
1883 |
+
|
1884 |
+
|
1885 |
+
|
1886 |
+
|
1887 |
+
Training...: 12199it [1:27:39, 5.79it/s]█████████████████████████████████████████████████████████████████████████████████████████████████| 500/500 [01:17<00:00, 7.90it/s]
|
1888 |
+
|
1889 |
+
|
1890 |
+
|
1891 |
+
|
1892 |
+
|
1893 |
+
Training...: 12249it [1:27:58, 6.06it/s]█████████████████████████████████████████████████████████████████████████████████████████████████| 500/500 [01:17<00:00, 7.90it/s]
|
1894 |
+
|
1895 |
+
|
1896 |
+
|
1897 |
+
|
1898 |
+
|
1899 |
+
|
1900 |
+
|
1901 |
+
Training...: 12301it [1:28:30, 2.19s/it]█████████████████████████████████████████████████████████████████████████████████████████████████| 500/500 [01:17<00:00, 7.90it/s]
|
1902 |
+
|
1903 |
+
|
1904 |
+
|
1905 |
+
|
1906 |
+
|
1907 |
+
|
1908 |
+
Training...: 12350it [1:28:50, 3.36s/it]█████████████████████████████████████████████████████████████████████████████████████████████████| 500/500 [01:17<00:00, 7.90it/s]
|
1909 |
+
|
1910 |
+
|
1911 |
+
|
1912 |
+
|
1913 |
+
|
1914 |
+
Training...: 12399it [1:28:59, 6.19it/s]█████████████████████████████████████████████████████████████████████████████████████████████████| 500/500 [01:17<00:00, 7.90it/s]
|
1915 |
+
|
1916 |
+
|
1917 |
+
|
1918 |
+
|
1919 |
+
|
1920 |
+
|
1921 |
+
Training...: 12450it [1:29:30, 3.28s/it]███████████��█████████████████████████████████████████████████████████████████████████████████████| 500/500 [01:17<00:00, 7.90it/s]
|
1922 |
+
|
1923 |
+
|
1924 |
+
|
1925 |
+
|
1926 |
+
|
1927 |
+
|
1928 |
+
Training...: 12500it [1:29:50, 3.33s/it]█████████████████████████████████████████████████████████████████████████████████████████████████| 500/500 [01:17<00:00, 7.90it/s]
|
1929 |
+
|
1930 |
+
|
1931 |
+
|
1932 |
+
|
1933 |
+
|
1934 |
+
|
1935 |
+
Training...: 12551it [1:30:11, 2.43s/it]█████████████████████████████████████████████████████████████████████████████████████████████████| 500/500 [01:17<00:00, 7.90it/s]
|
1936 |
+
|
1937 |
+
|
1938 |
+
|
1939 |
+
|
1940 |
+
|
1941 |
+
|
1942 |
+
Training...: 12601it [1:30:31, 2.51s/it]█████████████████████████████████████████████████████████████████████████████████████████████████| 500/500 [01:17<00:00, 7.90it/s]
|
1943 |
+
|
1944 |
+
|
1945 |
+
|
1946 |
+
|
1947 |
+
|
1948 |
+
|
1949 |
+
Training...: 12652it [1:30:51, 1.72s/it]█████████████████████████████████████████████████████████████████████████████████████████████████| 500/500 [01:17<00:00, 7.90it/s]
|
1950 |
+
|
1951 |
+
|
1952 |
+
|
1953 |
+
|
1954 |
+
|
1955 |
+
|
1956 |
+
Training...: 12701it [1:31:11, 2.31s/it]█████████████████████████████████████████████████████████████████████████████████████████████████| 500/500 [01:17<00:00, 7.90it/s]
|
1957 |
+
|
1958 |
+
|
1959 |
+
|
1960 |
+
|
1961 |
+
|
1962 |
+
Training...: 12749it [1:31:20, 5.69it/s]█████████████████████████████████████████████████████████████████████████████████████████████████| 500/500 [01:17<00:00, 7.90it/s]
|
1963 |
+
|
1964 |
+
|
1965 |
+
|
1966 |
+
|
1967 |
+
|
1968 |
+
|
1969 |
+
Training...: 12799it [1:31:41, 5.74it/s]█████████████████████████████████████████████████████████████████████████████████████████████████| 500/500 [01:17<00:00, 7.90it/s]
|
1970 |
+
|
1971 |
+
|
1972 |
+
|
1973 |
+
|
1974 |
+
|
1975 |
+
|
1976 |
+
Training...: 12849it [1:32:01, 4.90it/s]█████████████████████████████████████████████████████████████████████████████████████████████████| 500/500 [01:17<00:00, 7.90it/s]
|
1977 |
+
|
1978 |
+
|
1979 |
+
|
1980 |
+
|
1981 |
+
|
1982 |
+
|
1983 |
+
Training...: 12899it [1:32:21, 6.00it/s]█████████████████████████████████████████████████████████████████████████████████████████████████| 500/500 [01:17<00:00, 7.90it/s]
|
1984 |
+
|
1985 |
+
|
1986 |
+
|
1987 |
+
|
1988 |
+
|
1989 |
+
|
1990 |
+
Training...: 12949it [1:32:41, 4.88it/s]█████████████████████████████████████████████████████████████████████████████████████████████████| 500/500 [01:17<00:00, 7.90it/s]
|
1991 |
+
|
1992 |
+
|
1993 |
+
|
1994 |
+
|
1995 |
+
|
1996 |
+
|
1997 |
+
Training...: 12999it [1:33:02, 4.03it/s]█████████████████████████████████████████████████████████████████████████████████████████████████| 500/500 [01:17<00:00, 7.90it/s]
|
1998 |
+
|
1999 |
+
|
2000 |
+
|
2001 |
+
|
2002 |
+
|
2003 |
+
|
2004 |
+
Training...: 13049it [1:33:22, 5.20it/s]█████████████████████████████████████████████████████████████████████████████████████████████████| 500/500 [01:17<00:00, 7.90it/s]
|
2005 |
+
|
2006 |
+
|
2007 |
+
|
2008 |
+
|
2009 |
+
|
2010 |
+
|
2011 |
+
|
2012 |
+
Training...: 13107it [1:33:54, 2.24it/s]███████████████████████████████████████████████████████████████████████��█████████████████████████| 500/500 [01:17<00:00, 7.90it/s]
|
2013 |
+
|
2014 |
+
|
2015 |
+
|
2016 |
+
|
2017 |
+
Training...: 13149it [1:34:02, 4.53it/s]█████████████████████████████████████████████████████████████████████████████████████████████████| 500/500 [01:17<00:00, 7.90it/s]
|
2018 |
+
|
2019 |
+
|
2020 |
+
|
2021 |
+
|
2022 |
+
|
2023 |
+
|
2024 |
+
|
2025 |
+
Training...: 13209it [1:34:34, 3.21it/s]█████████████████████████████████████████████████████████████████████████████████████████████████| 500/500 [01:17<00:00, 7.90it/s]
|
2026 |
+
|
2027 |
+
|
2028 |
+
|
2029 |
+
|
2030 |
+
|
2031 |
+
|
2032 |
+
Training...: 13257it [1:34:54, 2.29it/s]█████████████████████████████████████████████████████████████████████████████████████████████████| 500/500 [01:17<00:00, 7.90it/s]
|
2033 |
+
|
2034 |
+
|
2035 |
+
|
2036 |
+
|
2037 |
+
|
2038 |
+
Training...: 13309it [1:35:15, 3.18it/s]█████████████████████████████████████████████████████████████████████████████████████████████████| 500/500 [01:17<00:00, 7.90it/s]
|
2039 |
+
|
2040 |
+
|
2041 |
+
|
2042 |
+
|
2043 |
+
|
2044 |
+
|
2045 |
+
Training...: 13357it [1:35:35, 2.21it/s]█████████████████████████████████████████████████████████████████████████████████████████████████| 500/500 [01:17<00:00, 7.90it/s]
|
2046 |
+
|
2047 |
+
|
2048 |
+
|
2049 |
+
|
2050 |
+
|
2051 |
+
Training...: 13400it [1:35:53, 3.30s/it]█████████████████████████████████████████████████████████████████████████████████████████████████| 500/500 [01:17<00:00, 7.90it/s]
|
2052 |
+
|
2053 |
+
|
2054 |
+
|
2055 |
+
|
2056 |
+
|
2057 |
+
Training...: 13449it [1:36:02, 6.12it/s]█████████████████████████████████████████████████████████████████████████████████████████████████| 500/500 [01:17<00:00, 7.90it/s]
|
2058 |
+
|
2059 |
+
|
2060 |
+
|
2061 |
+
|
2062 |
+
|
2063 |
+
|
2064 |
+
Training...: 13500it [1:36:34, 3.23s/it]█████████████████████████████████████████████████████████████████████████████████████████████████| 500/500 [01:17<00:00, 7.90it/s]
|
2065 |
+
|
2066 |
+
|
2067 |
+
|
2068 |
+
|
2069 |
+
|
2070 |
+
|
2071 |
+
Training...: 13551it [1:36:54, 2.35s/it]█████████████████████████████████████████████████████████████████████████████████████████████████| 500/500 [01:17<00:00, 7.90it/s]
|
2072 |
+
|
2073 |
+
|
2074 |
+
|
2075 |
+
|
2076 |
+
|
2077 |
+
|
2078 |
+
Training...: 13602it [1:37:15, 1.83s/it]█████████████████████████████████████████████████████████████████████████████████████████████████| 500/500 [01:17<00:00, 7.90it/s]
|
2079 |
+
|
2080 |
+
|
2081 |
+
|
2082 |
+
|
2083 |
+
|
2084 |
+
|
2085 |
+
Training...: 13651it [1:37:35, 2.23s/it]█████████████████████████████████████████████████████████████████████████████████████████████████| 500/500 [01:17<00:00, 7.90it/s]
|
2086 |
+
|
2087 |
+
|
2088 |
+
|
2089 |
+
|
2090 |
+
|
2091 |
+
|
2092 |
+
Training...: 13702it [1:37:55, 1.76s/it]█████████████████████████████████████████████████████████████████████████████████████████████████| 500/500 [01:17<00:00, 7.90it/s]
|
2093 |
+
|
2094 |
+
|
2095 |
+
|
2096 |
+
|
2097 |
+
|
2098 |
+
|
2099 |
+
Training...: 13752it [1:38:15, 1.79s/it]█████████████████████████████████████████████████████████████████████████████████████████████████| 500/500 [01:17<00:00, 7.90it/s]
|
2100 |
+
|
2101 |
+
|
2102 |
+
|
2103 |
+
|
2104 |
+
|
2105 |
+
|
2106 |
+
Training...: 13804it [1:38:36, 1.06it/s]███████��█████████████████████████████████████████████████████████████████████████████████████████| 500/500 [01:17<00:00, 7.90it/s]
|
2107 |
+
|
2108 |
+
|
2109 |
+
|
2110 |
+
|
2111 |
+
|
2112 |
+
|
2113 |
+
Training...: 13854it [1:38:56, 1.04it/s]█████████████████████████████████████████████████████████████████████████████████████████████████| 500/500 [01:17<00:00, 7.90it/s]
|
2114 |
+
|
2115 |
+
|
2116 |
+
|
2117 |
+
|
2118 |
+
|
2119 |
+
Training...: 13907it [1:39:16, 2.21it/s]█████████████████████████████████████████████████████████████████████████████████████████████████| 500/500 [01:17<00:00, 7.90it/s]
|
2120 |
+
|
2121 |
+
|
2122 |
+
|
2123 |
+
|
2124 |
+
|
2125 |
+
Training...: 13954it [1:39:36, 1.05it/s]█████████████████████████████████████████████████████████████████████████████████████████████████| 500/500 [01:17<00:00, 7.90it/s]
|
2126 |
+
|
2127 |
+
|
2128 |
+
|
2129 |
+
|
2130 |
+
Training...: 13999it [1:39:45, 5.27it/s]█████████████████████████████████████████████████████████████████████████████████████████████████| 500/500 [01:17<00:00, 7.90it/s]
|
2131 |
+
|
2132 |
+
|
2133 |
+
|
2134 |
+
|
2135 |
+
|
2136 |
+
|
2137 |
+
Training...: 14056it [1:40:17, 1.69it/s]█████████████████████████████████████████████████████████████████████████████████████████████████| 500/500 [01:17<00:00, 7.90it/s]
|
2138 |
+
|
2139 |
+
|
2140 |
+
|
2141 |
+
|
2142 |
+
|
2143 |
+
Training...: 14099it [1:40:25, 6.17it/s]█████████████████████████████████████████████████████████████████████████████████████████████████| 500/500 [01:17<00:00, 7.90it/s]
|
2144 |
+
|
2145 |
+
|
2146 |
+
|
2147 |
+
|
2148 |
+
|
2149 |
+
Training...: 14149it [1:40:45, 5.64it/s]█████████████████████████████████████████████████████████████████████████████████████████████████| 500/500 [01:17<00:00, 7.90it/s]
|
2150 |
+
|
2151 |
+
|
2152 |
+
|
2153 |
+
|
wandb/run-20210716_223350-8eukt20m/files/wandb-summary.json
CHANGED
@@ -1 +1 @@
|
|
1 |
-
{"training_step":
|
|
|
1 |
+
{"training_step": 344150, "learning_rate": 2.2845080820843577e-05, "train_loss": 1.9759552478790283, "_runtime": 6408, "_timestamp": 1626481238, "_step": 283, "eval_step": 340000, "eval_accuracy": 0.6408576965332031, "eval_loss": 1.8213207721710205}
|
wandb/run-20210716_223350-8eukt20m/logs/debug-internal.log
CHANGED
@@ -3607,3 +3607,647 @@
|
|
3607 |
2021-07-17 00:04:50,671 DEBUG SenderThread:799749 [sender.py:send():179] send: history
|
3608 |
2021-07-17 00:04:50,671 DEBUG SenderThread:799749 [sender.py:send():179] send: summary
|
3609 |
2021-07-17 00:04:50,671 INFO SenderThread:799749 [sender.py:_save_file():841] saving file wandb-summary.json with policy end
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
3607 |
2021-07-17 00:04:50,671 DEBUG SenderThread:799749 [sender.py:send():179] send: history
|
3608 |
2021-07-17 00:04:50,671 DEBUG SenderThread:799749 [sender.py:send():179] send: summary
|
3609 |
2021-07-17 00:04:50,671 INFO SenderThread:799749 [sender.py:_save_file():841] saving file wandb-summary.json with policy end
|
3610 |
+
2021-07-17 00:04:51,359 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/wandb-summary.json
|
3611 |
+
2021-07-17 00:04:52,360 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
3612 |
+
2021-07-17 00:04:54,360 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
3613 |
+
2021-07-17 00:04:56,361 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
3614 |
+
2021-07-17 00:04:59,363 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
3615 |
+
2021-07-17 00:05:00,492 DEBUG HandlerThread:799749 [handler.py:handle_request():124] handle_request: stop_status
|
3616 |
+
2021-07-17 00:05:00,493 DEBUG SenderThread:799749 [sender.py:send_request():193] send_request: stop_status
|
3617 |
+
2021-07-17 00:05:01,363 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
3618 |
+
2021-07-17 00:05:03,364 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
3619 |
+
2021-07-17 00:05:04,260 DEBUG SenderThread:799749 [sender.py:send():179] send: stats
|
3620 |
+
2021-07-17 00:05:10,826 DEBUG SenderThread:799749 [sender.py:send():179] send: history
|
3621 |
+
2021-07-17 00:05:10,826 DEBUG SenderThread:799749 [sender.py:send():179] send: summary
|
3622 |
+
2021-07-17 00:05:10,827 INFO SenderThread:799749 [sender.py:_save_file():841] saving file wandb-summary.json with policy end
|
3623 |
+
2021-07-17 00:05:11,368 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/wandb-summary.json
|
3624 |
+
2021-07-17 00:05:12,368 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
3625 |
+
2021-07-17 00:05:13,369 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
3626 |
+
2021-07-17 00:05:15,370 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
3627 |
+
2021-07-17 00:05:15,685 DEBUG HandlerThread:799749 [handler.py:handle_request():124] handle_request: stop_status
|
3628 |
+
2021-07-17 00:05:15,686 DEBUG SenderThread:799749 [sender.py:send_request():193] send_request: stop_status
|
3629 |
+
2021-07-17 00:05:17,371 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
3630 |
+
2021-07-17 00:05:19,372 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
3631 |
+
2021-07-17 00:05:21,373 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
3632 |
+
2021-07-17 00:05:23,374 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
3633 |
+
2021-07-17 00:05:30,844 DEBUG HandlerThread:799749 [handler.py:handle_request():124] handle_request: stop_status
|
3634 |
+
2021-07-17 00:05:30,844 DEBUG SenderThread:799749 [sender.py:send_request():193] send_request: stop_status
|
3635 |
+
2021-07-17 00:05:30,974 DEBUG SenderThread:799749 [sender.py:send():179] send: history
|
3636 |
+
2021-07-17 00:05:30,974 DEBUG SenderThread:799749 [sender.py:send():179] send: summary
|
3637 |
+
2021-07-17 00:05:30,975 INFO SenderThread:799749 [sender.py:_save_file():841] saving file wandb-summary.json with policy end
|
3638 |
+
2021-07-17 00:05:31,377 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/wandb-summary.json
|
3639 |
+
2021-07-17 00:05:33,378 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
3640 |
+
2021-07-17 00:05:34,335 DEBUG SenderThread:799749 [sender.py:send():179] send: stats
|
3641 |
+
2021-07-17 00:05:35,379 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
3642 |
+
2021-07-17 00:05:37,380 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
3643 |
+
2021-07-17 00:05:39,381 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
3644 |
+
2021-07-17 00:05:41,382 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
3645 |
+
2021-07-17 00:05:43,383 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
3646 |
+
2021-07-17 00:05:46,022 DEBUG HandlerThread:799749 [handler.py:handle_request():124] handle_request: stop_status
|
3647 |
+
2021-07-17 00:05:46,022 DEBUG SenderThread:799749 [sender.py:send_request():193] send_request: stop_status
|
3648 |
+
2021-07-17 00:05:51,122 DEBUG SenderThread:799749 [sender.py:send():179] send: history
|
3649 |
+
2021-07-17 00:05:51,122 DEBUG SenderThread:799749 [sender.py:send():179] send: summary
|
3650 |
+
2021-07-17 00:05:51,123 INFO SenderThread:799749 [sender.py:_save_file():841] saving file wandb-summary.json with policy end
|
3651 |
+
2021-07-17 00:05:51,386 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/wandb-summary.json
|
3652 |
+
2021-07-17 00:05:53,387 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
3653 |
+
2021-07-17 00:05:55,388 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
3654 |
+
2021-07-17 00:05:57,389 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
3655 |
+
2021-07-17 00:05:59,390 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
3656 |
+
2021-07-17 00:06:01,232 DEBUG HandlerThread:799749 [handler.py:handle_request():124] handle_request: stop_status
|
3657 |
+
2021-07-17 00:06:01,232 DEBUG SenderThread:799749 [sender.py:send_request():193] send_request: stop_status
|
3658 |
+
2021-07-17 00:06:01,391 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
3659 |
+
2021-07-17 00:06:04,409 DEBUG SenderThread:799749 [sender.py:send():179] send: stats
|
3660 |
+
2021-07-17 00:06:11,364 DEBUG SenderThread:799749 [sender.py:send():179] send: history
|
3661 |
+
2021-07-17 00:06:11,364 DEBUG SenderThread:799749 [sender.py:send():179] send: summary
|
3662 |
+
2021-07-17 00:06:11,364 INFO SenderThread:799749 [sender.py:_save_file():841] saving file wandb-summary.json with policy end
|
3663 |
+
2021-07-17 00:06:11,395 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/wandb-summary.json
|
3664 |
+
2021-07-17 00:06:13,396 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
3665 |
+
2021-07-17 00:06:15,397 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
3666 |
+
2021-07-17 00:06:16,443 DEBUG HandlerThread:799749 [handler.py:handle_request():124] handle_request: stop_status
|
3667 |
+
2021-07-17 00:06:16,443 DEBUG SenderThread:799749 [sender.py:send_request():193] send_request: stop_status
|
3668 |
+
2021-07-17 00:06:18,398 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
3669 |
+
2021-07-17 00:06:20,399 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
3670 |
+
2021-07-17 00:06:22,400 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
3671 |
+
2021-07-17 00:06:24,401 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
3672 |
+
2021-07-17 00:06:31,511 DEBUG SenderThread:799749 [sender.py:send():179] send: history
|
3673 |
+
2021-07-17 00:06:31,512 DEBUG SenderThread:799749 [sender.py:send():179] send: summary
|
3674 |
+
2021-07-17 00:06:31,512 INFO SenderThread:799749 [sender.py:_save_file():841] saving file wandb-summary.json with policy end
|
3675 |
+
2021-07-17 00:06:31,682 DEBUG HandlerThread:799749 [handler.py:handle_request():124] handle_request: stop_status
|
3676 |
+
2021-07-17 00:06:31,683 DEBUG SenderThread:799749 [sender.py:send_request():193] send_request: stop_status
|
3677 |
+
2021-07-17 00:06:32,405 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/wandb-summary.json
|
3678 |
+
2021-07-17 00:06:33,405 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
3679 |
+
2021-07-17 00:06:34,406 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
3680 |
+
2021-07-17 00:06:34,482 DEBUG SenderThread:799749 [sender.py:send():179] send: stats
|
3681 |
+
2021-07-17 00:06:36,406 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
3682 |
+
2021-07-17 00:06:38,407 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
3683 |
+
2021-07-17 00:06:40,408 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
3684 |
+
2021-07-17 00:06:42,409 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
3685 |
+
2021-07-17 00:06:46,879 DEBUG HandlerThread:799749 [handler.py:handle_request():124] handle_request: stop_status
|
3686 |
+
2021-07-17 00:06:46,879 DEBUG SenderThread:799749 [sender.py:send_request():193] send_request: stop_status
|
3687 |
+
2021-07-17 00:06:51,687 DEBUG SenderThread:799749 [sender.py:send():179] send: history
|
3688 |
+
2021-07-17 00:06:51,687 DEBUG SenderThread:799749 [sender.py:send():179] send: summary
|
3689 |
+
2021-07-17 00:06:51,688 INFO SenderThread:799749 [sender.py:_save_file():841] saving file wandb-summary.json with policy end
|
3690 |
+
2021-07-17 00:06:52,414 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/wandb-summary.json
|
3691 |
+
2021-07-17 00:06:53,414 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
3692 |
+
2021-07-17 00:06:54,414 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
3693 |
+
2021-07-17 00:06:56,415 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
3694 |
+
2021-07-17 00:06:58,416 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
3695 |
+
2021-07-17 00:07:00,417 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
3696 |
+
2021-07-17 00:07:02,010 DEBUG HandlerThread:799749 [handler.py:handle_request():124] handle_request: stop_status
|
3697 |
+
2021-07-17 00:07:02,011 DEBUG SenderThread:799749 [sender.py:send_request():193] send_request: stop_status
|
3698 |
+
2021-07-17 00:07:02,418 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
3699 |
+
2021-07-17 00:07:04,558 DEBUG SenderThread:799749 [sender.py:send():179] send: stats
|
3700 |
+
2021-07-17 00:07:11,868 DEBUG SenderThread:799749 [sender.py:send():179] send: history
|
3701 |
+
2021-07-17 00:07:11,868 DEBUG SenderThread:799749 [sender.py:send():179] send: summary
|
3702 |
+
2021-07-17 00:07:11,869 INFO SenderThread:799749 [sender.py:_save_file():841] saving file wandb-summary.json with policy end
|
3703 |
+
2021-07-17 00:07:12,422 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/wandb-summary.json
|
3704 |
+
2021-07-17 00:07:13,422 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
3705 |
+
2021-07-17 00:07:14,423 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
3706 |
+
2021-07-17 00:07:16,423 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
3707 |
+
2021-07-17 00:07:17,189 DEBUG HandlerThread:799749 [handler.py:handle_request():124] handle_request: stop_status
|
3708 |
+
2021-07-17 00:07:17,189 DEBUG SenderThread:799749 [sender.py:send_request():193] send_request: stop_status
|
3709 |
+
2021-07-17 00:07:18,424 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
3710 |
+
2021-07-17 00:07:20,425 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
3711 |
+
2021-07-17 00:07:22,426 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
3712 |
+
2021-07-17 00:07:24,427 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
3713 |
+
2021-07-17 00:07:32,074 DEBUG SenderThread:799749 [sender.py:send():179] send: history
|
3714 |
+
2021-07-17 00:07:32,074 DEBUG SenderThread:799749 [sender.py:send():179] send: summary
|
3715 |
+
2021-07-17 00:07:32,075 INFO SenderThread:799749 [sender.py:_save_file():841] saving file wandb-summary.json with policy end
|
3716 |
+
2021-07-17 00:07:32,393 DEBUG HandlerThread:799749 [handler.py:handle_request():124] handle_request: stop_status
|
3717 |
+
2021-07-17 00:07:32,393 DEBUG SenderThread:799749 [sender.py:send_request():193] send_request: stop_status
|
3718 |
+
2021-07-17 00:07:32,430 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/wandb-summary.json
|
3719 |
+
2021-07-17 00:07:33,430 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
3720 |
+
2021-07-17 00:07:34,431 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
3721 |
+
2021-07-17 00:07:34,632 DEBUG SenderThread:799749 [sender.py:send():179] send: stats
|
3722 |
+
2021-07-17 00:07:36,432 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
3723 |
+
2021-07-17 00:07:39,433 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
3724 |
+
2021-07-17 00:07:41,434 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
3725 |
+
2021-07-17 00:07:43,435 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
3726 |
+
2021-07-17 00:07:47,527 DEBUG HandlerThread:799749 [handler.py:handle_request():124] handle_request: stop_status
|
3727 |
+
2021-07-17 00:07:47,528 DEBUG SenderThread:799749 [sender.py:send_request():193] send_request: stop_status
|
3728 |
+
2021-07-17 00:07:52,282 DEBUG SenderThread:799749 [sender.py:send():179] send: history
|
3729 |
+
2021-07-17 00:07:52,282 DEBUG SenderThread:799749 [sender.py:send():179] send: summary
|
3730 |
+
2021-07-17 00:07:52,283 INFO SenderThread:799749 [sender.py:_save_file():841] saving file wandb-summary.json with policy end
|
3731 |
+
2021-07-17 00:07:52,438 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/wandb-summary.json
|
3732 |
+
2021-07-17 00:07:53,439 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
3733 |
+
2021-07-17 00:07:55,440 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
3734 |
+
2021-07-17 00:07:57,440 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
3735 |
+
2021-07-17 00:07:59,441 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
3736 |
+
2021-07-17 00:08:01,442 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
3737 |
+
2021-07-17 00:08:02,702 DEBUG HandlerThread:799749 [handler.py:handle_request():124] handle_request: stop_status
|
3738 |
+
2021-07-17 00:08:02,703 DEBUG SenderThread:799749 [sender.py:send_request():193] send_request: stop_status
|
3739 |
+
2021-07-17 00:08:03,443 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
3740 |
+
2021-07-17 00:08:04,703 DEBUG SenderThread:799749 [sender.py:send():179] send: stats
|
3741 |
+
2021-07-17 00:08:05,444 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
3742 |
+
2021-07-17 00:08:12,419 DEBUG SenderThread:799749 [sender.py:send():179] send: history
|
3743 |
+
2021-07-17 00:08:12,419 DEBUG SenderThread:799749 [sender.py:send():179] send: summary
|
3744 |
+
2021-07-17 00:08:12,420 INFO SenderThread:799749 [sender.py:_save_file():841] saving file wandb-summary.json with policy end
|
3745 |
+
2021-07-17 00:08:12,447 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/wandb-summary.json
|
3746 |
+
2021-07-17 00:08:13,447 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
3747 |
+
2021-07-17 00:08:14,448 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
3748 |
+
2021-07-17 00:08:15,448 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
3749 |
+
2021-07-17 00:08:17,449 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
3750 |
+
2021-07-17 00:08:17,900 DEBUG HandlerThread:799749 [handler.py:handle_request():124] handle_request: stop_status
|
3751 |
+
2021-07-17 00:08:17,900 DEBUG SenderThread:799749 [sender.py:send_request():193] send_request: stop_status
|
3752 |
+
2021-07-17 00:08:19,450 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
3753 |
+
2021-07-17 00:08:21,451 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
3754 |
+
2021-07-17 00:08:23,452 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
3755 |
+
2021-07-17 00:08:32,629 DEBUG SenderThread:799749 [sender.py:send():179] send: history
|
3756 |
+
2021-07-17 00:08:32,629 DEBUG SenderThread:799749 [sender.py:send():179] send: summary
|
3757 |
+
2021-07-17 00:08:32,630 INFO SenderThread:799749 [sender.py:_save_file():841] saving file wandb-summary.json with policy end
|
3758 |
+
2021-07-17 00:08:33,095 DEBUG HandlerThread:799749 [handler.py:handle_request():124] handle_request: stop_status
|
3759 |
+
2021-07-17 00:08:33,096 DEBUG SenderThread:799749 [sender.py:send_request():193] send_request: stop_status
|
3760 |
+
2021-07-17 00:08:33,456 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
3761 |
+
2021-07-17 00:08:33,456 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/wandb-summary.json
|
3762 |
+
2021-07-17 00:08:34,456 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
3763 |
+
2021-07-17 00:08:34,778 DEBUG SenderThread:799749 [sender.py:send():179] send: stats
|
3764 |
+
2021-07-17 00:08:35,456 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
3765 |
+
2021-07-17 00:08:37,457 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
3766 |
+
2021-07-17 00:08:39,458 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
3767 |
+
2021-07-17 00:08:41,459 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
3768 |
+
2021-07-17 00:08:43,460 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
3769 |
+
2021-07-17 00:08:48,292 DEBUG HandlerThread:799749 [handler.py:handle_request():124] handle_request: stop_status
|
3770 |
+
2021-07-17 00:08:48,292 DEBUG SenderThread:799749 [sender.py:send_request():193] send_request: stop_status
|
3771 |
+
2021-07-17 00:08:52,817 DEBUG SenderThread:799749 [sender.py:send():179] send: history
|
3772 |
+
2021-07-17 00:08:52,817 DEBUG SenderThread:799749 [sender.py:send():179] send: summary
|
3773 |
+
2021-07-17 00:08:52,818 INFO SenderThread:799749 [sender.py:_save_file():841] saving file wandb-summary.json with policy end
|
3774 |
+
2021-07-17 00:08:53,464 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/wandb-summary.json
|
3775 |
+
2021-07-17 00:08:54,465 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
3776 |
+
2021-07-17 00:08:55,465 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
3777 |
+
2021-07-17 00:08:57,466 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
3778 |
+
2021-07-17 00:08:59,467 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
3779 |
+
2021-07-17 00:09:01,468 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
3780 |
+
2021-07-17 00:09:03,424 DEBUG HandlerThread:799749 [handler.py:handle_request():124] handle_request: stop_status
|
3781 |
+
2021-07-17 00:09:03,424 DEBUG SenderThread:799749 [sender.py:send_request():193] send_request: stop_status
|
3782 |
+
2021-07-17 00:09:03,469 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
3783 |
+
2021-07-17 00:09:04,852 DEBUG SenderThread:799749 [sender.py:send():179] send: stats
|
3784 |
+
2021-07-17 00:09:13,130 DEBUG SenderThread:799749 [sender.py:send():179] send: history
|
3785 |
+
2021-07-17 00:09:13,130 DEBUG SenderThread:799749 [sender.py:send():179] send: summary
|
3786 |
+
2021-07-17 00:09:13,131 INFO SenderThread:799749 [sender.py:_save_file():841] saving file wandb-summary.json with policy end
|
3787 |
+
2021-07-17 00:09:13,473 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
3788 |
+
2021-07-17 00:09:13,473 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/wandb-summary.json
|
3789 |
+
2021-07-17 00:09:14,474 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
3790 |
+
2021-07-17 00:09:16,474 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
3791 |
+
2021-07-17 00:09:18,475 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
3792 |
+
2021-07-17 00:09:18,573 DEBUG HandlerThread:799749 [handler.py:handle_request():124] handle_request: stop_status
|
3793 |
+
2021-07-17 00:09:18,574 DEBUG SenderThread:799749 [sender.py:send_request():193] send_request: stop_status
|
3794 |
+
2021-07-17 00:09:20,476 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
3795 |
+
2021-07-17 00:09:22,477 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
3796 |
+
2021-07-17 00:09:24,478 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
3797 |
+
2021-07-17 00:09:33,265 DEBUG SenderThread:799749 [sender.py:send():179] send: history
|
3798 |
+
2021-07-17 00:09:33,265 DEBUG SenderThread:799749 [sender.py:send():179] send: summary
|
3799 |
+
2021-07-17 00:09:33,266 INFO SenderThread:799749 [sender.py:_save_file():841] saving file wandb-summary.json with policy end
|
3800 |
+
2021-07-17 00:09:33,482 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/wandb-summary.json
|
3801 |
+
2021-07-17 00:09:33,871 DEBUG HandlerThread:799749 [handler.py:handle_request():124] handle_request: stop_status
|
3802 |
+
2021-07-17 00:09:33,872 DEBUG SenderThread:799749 [sender.py:send_request():193] send_request: stop_status
|
3803 |
+
2021-07-17 00:09:34,483 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
3804 |
+
2021-07-17 00:09:34,922 DEBUG SenderThread:799749 [sender.py:send():179] send: stats
|
3805 |
+
2021-07-17 00:09:36,483 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
3806 |
+
2021-07-17 00:09:38,484 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
3807 |
+
2021-07-17 00:09:40,485 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
3808 |
+
2021-07-17 00:09:42,486 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
3809 |
+
2021-07-17 00:09:44,487 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
3810 |
+
2021-07-17 00:09:49,131 DEBUG HandlerThread:799749 [handler.py:handle_request():124] handle_request: stop_status
|
3811 |
+
2021-07-17 00:09:49,131 DEBUG SenderThread:799749 [sender.py:send_request():193] send_request: stop_status
|
3812 |
+
2021-07-17 00:09:53,471 DEBUG SenderThread:799749 [sender.py:send():179] send: history
|
3813 |
+
2021-07-17 00:09:53,471 DEBUG SenderThread:799749 [sender.py:send():179] send: summary
|
3814 |
+
2021-07-17 00:09:53,472 INFO SenderThread:799749 [sender.py:_save_file():841] saving file wandb-summary.json with policy end
|
3815 |
+
2021-07-17 00:09:53,491 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/wandb-summary.json
|
3816 |
+
2021-07-17 00:09:54,492 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
3817 |
+
2021-07-17 00:09:56,493 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
3818 |
+
2021-07-17 00:09:58,494 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
3819 |
+
2021-07-17 00:10:00,495 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
3820 |
+
2021-07-17 00:10:02,496 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
3821 |
+
2021-07-17 00:10:04,263 DEBUG HandlerThread:799749 [handler.py:handle_request():124] handle_request: stop_status
|
3822 |
+
2021-07-17 00:10:04,263 DEBUG SenderThread:799749 [sender.py:send_request():193] send_request: stop_status
|
3823 |
+
2021-07-17 00:10:04,496 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
3824 |
+
2021-07-17 00:10:04,991 DEBUG SenderThread:799749 [sender.py:send():179] send: stats
|
3825 |
+
2021-07-17 00:10:13,602 DEBUG SenderThread:799749 [sender.py:send():179] send: history
|
3826 |
+
2021-07-17 00:10:13,603 DEBUG SenderThread:799749 [sender.py:send():179] send: summary
|
3827 |
+
2021-07-17 00:10:13,603 INFO SenderThread:799749 [sender.py:_save_file():841] saving file wandb-summary.json with policy end
|
3828 |
+
2021-07-17 00:10:14,500 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
3829 |
+
2021-07-17 00:10:14,501 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/wandb-summary.json
|
3830 |
+
2021-07-17 00:10:16,501 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
3831 |
+
2021-07-17 00:10:18,502 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
3832 |
+
2021-07-17 00:10:19,407 DEBUG HandlerThread:799749 [handler.py:handle_request():124] handle_request: stop_status
|
3833 |
+
2021-07-17 00:10:19,407 DEBUG SenderThread:799749 [sender.py:send_request():193] send_request: stop_status
|
3834 |
+
2021-07-17 00:10:20,503 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
3835 |
+
2021-07-17 00:10:22,504 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
3836 |
+
2021-07-17 00:10:24,505 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
3837 |
+
2021-07-17 00:10:33,818 DEBUG SenderThread:799749 [sender.py:send():179] send: history
|
3838 |
+
2021-07-17 00:10:33,818 DEBUG SenderThread:799749 [sender.py:send():179] send: summary
|
3839 |
+
2021-07-17 00:10:33,819 INFO SenderThread:799749 [sender.py:_save_file():841] saving file wandb-summary.json with policy end
|
3840 |
+
2021-07-17 00:10:34,508 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
3841 |
+
2021-07-17 00:10:34,509 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/wandb-summary.json
|
3842 |
+
2021-07-17 00:10:34,643 DEBUG HandlerThread:799749 [handler.py:handle_request():124] handle_request: stop_status
|
3843 |
+
2021-07-17 00:10:34,643 DEBUG SenderThread:799749 [sender.py:send_request():193] send_request: stop_status
|
3844 |
+
2021-07-17 00:10:35,059 DEBUG SenderThread:799749 [sender.py:send():179] send: stats
|
3845 |
+
2021-07-17 00:10:35,509 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
3846 |
+
2021-07-17 00:10:36,509 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
3847 |
+
2021-07-17 00:10:38,510 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
3848 |
+
2021-07-17 00:10:40,511 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
3849 |
+
2021-07-17 00:10:42,512 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
3850 |
+
2021-07-17 00:10:45,513 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
3851 |
+
2021-07-17 00:10:49,842 DEBUG HandlerThread:799749 [handler.py:handle_request():124] handle_request: stop_status
|
3852 |
+
2021-07-17 00:10:49,842 DEBUG SenderThread:799749 [sender.py:send_request():193] send_request: stop_status
|
3853 |
+
2021-07-17 00:10:54,000 DEBUG SenderThread:799749 [sender.py:send():179] send: history
|
3854 |
+
2021-07-17 00:10:54,000 DEBUG SenderThread:799749 [sender.py:send():179] send: summary
|
3855 |
+
2021-07-17 00:10:54,001 INFO SenderThread:799749 [sender.py:_save_file():841] saving file wandb-summary.json with policy end
|
3856 |
+
2021-07-17 00:10:54,517 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/wandb-summary.json
|
3857 |
+
2021-07-17 00:10:55,518 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
3858 |
+
2021-07-17 00:10:57,519 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
3859 |
+
2021-07-17 00:10:59,520 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
3860 |
+
2021-07-17 00:11:01,521 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
3861 |
+
2021-07-17 00:11:03,522 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
3862 |
+
2021-07-17 00:11:04,971 DEBUG HandlerThread:799749 [handler.py:handle_request():124] handle_request: stop_status
|
3863 |
+
2021-07-17 00:11:04,972 DEBUG SenderThread:799749 [sender.py:send_request():193] send_request: stop_status
|
3864 |
+
2021-07-17 00:11:05,126 DEBUG SenderThread:799749 [sender.py:send():179] send: stats
|
3865 |
+
2021-07-17 00:11:05,523 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
3866 |
+
2021-07-17 00:11:14,147 DEBUG SenderThread:799749 [sender.py:send():179] send: history
|
3867 |
+
2021-07-17 00:11:14,148 DEBUG SenderThread:799749 [sender.py:send():179] send: summary
|
3868 |
+
2021-07-17 00:11:14,148 INFO SenderThread:799749 [sender.py:_save_file():841] saving file wandb-summary.json with policy end
|
3869 |
+
2021-07-17 00:11:14,526 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/wandb-summary.json
|
3870 |
+
2021-07-17 00:11:15,527 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
3871 |
+
2021-07-17 00:11:17,528 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
3872 |
+
2021-07-17 00:11:19,529 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
3873 |
+
2021-07-17 00:11:20,106 DEBUG HandlerThread:799749 [handler.py:handle_request():124] handle_request: stop_status
|
3874 |
+
2021-07-17 00:11:20,107 DEBUG SenderThread:799749 [sender.py:send_request():193] send_request: stop_status
|
3875 |
+
2021-07-17 00:11:21,530 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
3876 |
+
2021-07-17 00:11:23,531 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
3877 |
+
2021-07-17 00:11:25,532 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
3878 |
+
2021-07-17 00:11:34,235 DEBUG SenderThread:799749 [sender.py:send():179] send: history
|
3879 |
+
2021-07-17 00:11:34,235 DEBUG SenderThread:799749 [sender.py:send():179] send: summary
|
3880 |
+
2021-07-17 00:11:34,236 INFO SenderThread:799749 [sender.py:_save_file():841] saving file wandb-summary.json with policy end
|
3881 |
+
2021-07-17 00:11:34,536 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/wandb-summary.json
|
3882 |
+
2021-07-17 00:11:35,195 DEBUG SenderThread:799749 [sender.py:send():179] send: stats
|
3883 |
+
2021-07-17 00:11:35,261 DEBUG HandlerThread:799749 [handler.py:handle_request():124] handle_request: stop_status
|
3884 |
+
2021-07-17 00:11:35,262 DEBUG SenderThread:799749 [sender.py:send_request():193] send_request: stop_status
|
3885 |
+
2021-07-17 00:11:35,536 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
3886 |
+
2021-07-17 00:11:37,537 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
3887 |
+
2021-07-17 00:11:39,538 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
3888 |
+
2021-07-17 00:11:41,539 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
3889 |
+
2021-07-17 00:11:43,539 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
3890 |
+
2021-07-17 00:11:45,540 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
3891 |
+
2021-07-17 00:11:50,473 DEBUG HandlerThread:799749 [handler.py:handle_request():124] handle_request: stop_status
|
3892 |
+
2021-07-17 00:11:50,474 DEBUG SenderThread:799749 [sender.py:send_request():193] send_request: stop_status
|
3893 |
+
2021-07-17 00:11:54,378 DEBUG SenderThread:799749 [sender.py:send():179] send: history
|
3894 |
+
2021-07-17 00:11:54,379 DEBUG SenderThread:799749 [sender.py:send():179] send: summary
|
3895 |
+
2021-07-17 00:11:54,379 INFO SenderThread:799749 [sender.py:_save_file():841] saving file wandb-summary.json with policy end
|
3896 |
+
2021-07-17 00:11:54,544 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/wandb-summary.json
|
3897 |
+
2021-07-17 00:11:55,544 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
3898 |
+
2021-07-17 00:11:58,545 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
3899 |
+
2021-07-17 00:12:00,546 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
3900 |
+
2021-07-17 00:12:02,547 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
3901 |
+
2021-07-17 00:12:04,548 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
3902 |
+
2021-07-17 00:12:05,268 DEBUG SenderThread:799749 [sender.py:send():179] send: stats
|
3903 |
+
2021-07-17 00:12:05,606 DEBUG HandlerThread:799749 [handler.py:handle_request():124] handle_request: stop_status
|
3904 |
+
2021-07-17 00:12:05,607 DEBUG SenderThread:799749 [sender.py:send_request():193] send_request: stop_status
|
3905 |
+
2021-07-17 00:12:06,549 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
3906 |
+
2021-07-17 00:12:14,534 DEBUG SenderThread:799749 [sender.py:send():179] send: history
|
3907 |
+
2021-07-17 00:12:14,535 DEBUG SenderThread:799749 [sender.py:send():179] send: summary
|
3908 |
+
2021-07-17 00:12:14,535 INFO SenderThread:799749 [sender.py:_save_file():841] saving file wandb-summary.json with policy end
|
3909 |
+
2021-07-17 00:12:14,551 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/wandb-summary.json
|
3910 |
+
2021-07-17 00:12:15,552 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
3911 |
+
2021-07-17 00:12:16,552 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
3912 |
+
2021-07-17 00:12:18,553 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
3913 |
+
2021-07-17 00:12:20,554 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
3914 |
+
2021-07-17 00:12:20,792 DEBUG HandlerThread:799749 [handler.py:handle_request():124] handle_request: stop_status
|
3915 |
+
2021-07-17 00:12:20,792 DEBUG SenderThread:799749 [sender.py:send_request():193] send_request: stop_status
|
3916 |
+
2021-07-17 00:12:22,555 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
3917 |
+
2021-07-17 00:12:24,556 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
3918 |
+
2021-07-17 00:12:26,556 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
3919 |
+
2021-07-17 00:12:34,781 DEBUG SenderThread:799749 [sender.py:send():179] send: history
|
3920 |
+
2021-07-17 00:12:34,782 DEBUG SenderThread:799749 [sender.py:send():179] send: summary
|
3921 |
+
2021-07-17 00:12:34,782 INFO SenderThread:799749 [sender.py:_save_file():841] saving file wandb-summary.json with policy end
|
3922 |
+
2021-07-17 00:12:35,339 DEBUG SenderThread:799749 [sender.py:send():179] send: stats
|
3923 |
+
2021-07-17 00:12:35,560 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
3924 |
+
2021-07-17 00:12:35,560 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/wandb-summary.json
|
3925 |
+
2021-07-17 00:12:35,975 DEBUG HandlerThread:799749 [handler.py:handle_request():124] handle_request: stop_status
|
3926 |
+
2021-07-17 00:12:35,976 DEBUG SenderThread:799749 [sender.py:send_request():193] send_request: stop_status
|
3927 |
+
2021-07-17 00:12:36,561 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
3928 |
+
2021-07-17 00:12:38,562 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
3929 |
+
2021-07-17 00:12:40,562 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
3930 |
+
2021-07-17 00:12:42,563 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
3931 |
+
2021-07-17 00:12:44,564 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
3932 |
+
2021-07-17 00:12:46,565 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
3933 |
+
2021-07-17 00:12:51,149 DEBUG HandlerThread:799749 [handler.py:handle_request():124] handle_request: stop_status
|
3934 |
+
2021-07-17 00:12:51,149 DEBUG SenderThread:799749 [sender.py:send_request():193] send_request: stop_status
|
3935 |
+
2021-07-17 00:12:54,966 DEBUG SenderThread:799749 [sender.py:send():179] send: history
|
3936 |
+
2021-07-17 00:12:54,967 DEBUG SenderThread:799749 [sender.py:send():179] send: summary
|
3937 |
+
2021-07-17 00:12:54,967 INFO SenderThread:799749 [sender.py:_save_file():841] saving file wandb-summary.json with policy end
|
3938 |
+
2021-07-17 00:12:55,568 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
3939 |
+
2021-07-17 00:12:55,568 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/wandb-summary.json
|
3940 |
+
2021-07-17 00:12:56,569 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
3941 |
+
2021-07-17 00:12:58,569 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
3942 |
+
2021-07-17 00:13:00,570 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
3943 |
+
2021-07-17 00:13:02,571 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
3944 |
+
2021-07-17 00:13:04,572 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
3945 |
+
2021-07-17 00:13:05,413 DEBUG SenderThread:799749 [sender.py:send():179] send: stats
|
3946 |
+
2021-07-17 00:13:06,280 DEBUG HandlerThread:799749 [handler.py:handle_request():124] handle_request: stop_status
|
3947 |
+
2021-07-17 00:13:06,281 DEBUG SenderThread:799749 [sender.py:send_request():193] send_request: stop_status
|
3948 |
+
2021-07-17 00:13:07,573 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
3949 |
+
2021-07-17 00:13:15,188 DEBUG SenderThread:799749 [sender.py:send():179] send: history
|
3950 |
+
2021-07-17 00:13:15,188 DEBUG SenderThread:799749 [sender.py:send():179] send: summary
|
3951 |
+
2021-07-17 00:13:15,189 INFO SenderThread:799749 [sender.py:_save_file():841] saving file wandb-summary.json with policy end
|
3952 |
+
2021-07-17 00:13:15,576 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
3953 |
+
2021-07-17 00:13:15,576 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/wandb-summary.json
|
3954 |
+
2021-07-17 00:13:17,577 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
3955 |
+
2021-07-17 00:13:19,578 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
3956 |
+
2021-07-17 00:13:21,481 DEBUG HandlerThread:799749 [handler.py:handle_request():124] handle_request: stop_status
|
3957 |
+
2021-07-17 00:13:21,482 DEBUG SenderThread:799749 [sender.py:send_request():193] send_request: stop_status
|
3958 |
+
2021-07-17 00:13:21,579 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
3959 |
+
2021-07-17 00:13:23,580 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
3960 |
+
2021-07-17 00:13:25,581 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
3961 |
+
2021-07-17 00:13:27,581 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
3962 |
+
2021-07-17 00:13:35,343 DEBUG SenderThread:799749 [sender.py:send():179] send: history
|
3963 |
+
2021-07-17 00:13:35,343 DEBUG SenderThread:799749 [sender.py:send():179] send: summary
|
3964 |
+
2021-07-17 00:13:35,344 INFO SenderThread:799749 [sender.py:_save_file():841] saving file wandb-summary.json with policy end
|
3965 |
+
2021-07-17 00:13:35,485 DEBUG SenderThread:799749 [sender.py:send():179] send: stats
|
3966 |
+
2021-07-17 00:13:35,585 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/wandb-summary.json
|
3967 |
+
2021-07-17 00:13:36,665 DEBUG HandlerThread:799749 [handler.py:handle_request():124] handle_request: stop_status
|
3968 |
+
2021-07-17 00:13:36,665 DEBUG SenderThread:799749 [sender.py:send_request():193] send_request: stop_status
|
3969 |
+
2021-07-17 00:13:37,586 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
3970 |
+
2021-07-17 00:13:38,586 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
3971 |
+
2021-07-17 00:13:39,587 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
3972 |
+
2021-07-17 00:13:41,587 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
3973 |
+
2021-07-17 00:13:43,588 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
3974 |
+
2021-07-17 00:13:45,589 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
3975 |
+
2021-07-17 00:13:51,851 DEBUG HandlerThread:799749 [handler.py:handle_request():124] handle_request: stop_status
|
3976 |
+
2021-07-17 00:13:51,851 DEBUG SenderThread:799749 [sender.py:send_request():193] send_request: stop_status
|
3977 |
+
2021-07-17 00:13:55,544 DEBUG SenderThread:799749 [sender.py:send():179] send: history
|
3978 |
+
2021-07-17 00:13:55,544 DEBUG SenderThread:799749 [sender.py:send():179] send: summary
|
3979 |
+
2021-07-17 00:13:55,545 INFO SenderThread:799749 [sender.py:_save_file():841] saving file wandb-summary.json with policy end
|
3980 |
+
2021-07-17 00:13:55,593 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/wandb-summary.json
|
3981 |
+
2021-07-17 00:13:56,594 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
3982 |
+
2021-07-17 00:13:57,594 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
3983 |
+
2021-07-17 00:13:59,595 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
3984 |
+
2021-07-17 00:14:01,596 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
3985 |
+
2021-07-17 00:14:03,597 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
3986 |
+
2021-07-17 00:14:05,557 DEBUG SenderThread:799749 [sender.py:send():179] send: stats
|
3987 |
+
2021-07-17 00:14:05,597 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
3988 |
+
2021-07-17 00:14:06,984 DEBUG HandlerThread:799749 [handler.py:handle_request():124] handle_request: stop_status
|
3989 |
+
2021-07-17 00:14:06,985 DEBUG SenderThread:799749 [sender.py:send_request():193] send_request: stop_status
|
3990 |
+
2021-07-17 00:14:07,598 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
3991 |
+
2021-07-17 00:14:15,828 DEBUG SenderThread:799749 [sender.py:send():179] send: history
|
3992 |
+
2021-07-17 00:14:15,829 DEBUG SenderThread:799749 [sender.py:send():179] send: summary
|
3993 |
+
2021-07-17 00:14:15,829 INFO SenderThread:799749 [sender.py:_save_file():841] saving file wandb-summary.json with policy end
|
3994 |
+
2021-07-17 00:14:16,601 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/wandb-summary.json
|
3995 |
+
2021-07-17 00:14:18,602 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
3996 |
+
2021-07-17 00:14:20,603 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
3997 |
+
2021-07-17 00:14:22,162 DEBUG HandlerThread:799749 [handler.py:handle_request():124] handle_request: stop_status
|
3998 |
+
2021-07-17 00:14:22,162 DEBUG SenderThread:799749 [sender.py:send_request():193] send_request: stop_status
|
3999 |
+
2021-07-17 00:14:22,604 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
4000 |
+
2021-07-17 00:14:24,605 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
4001 |
+
2021-07-17 00:14:26,606 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
4002 |
+
2021-07-17 00:14:28,607 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
4003 |
+
2021-07-17 00:14:35,630 DEBUG SenderThread:799749 [sender.py:send():179] send: stats
|
4004 |
+
2021-07-17 00:14:36,002 DEBUG SenderThread:799749 [sender.py:send():179] send: history
|
4005 |
+
2021-07-17 00:14:36,003 DEBUG SenderThread:799749 [sender.py:send():179] send: summary
|
4006 |
+
2021-07-17 00:14:36,004 INFO SenderThread:799749 [sender.py:_save_file():841] saving file wandb-summary.json with policy end
|
4007 |
+
2021-07-17 00:14:36,611 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/wandb-summary.json
|
4008 |
+
2021-07-17 00:14:37,382 DEBUG HandlerThread:799749 [handler.py:handle_request():124] handle_request: stop_status
|
4009 |
+
2021-07-17 00:14:37,383 DEBUG SenderThread:799749 [sender.py:send_request():193] send_request: stop_status
|
4010 |
+
2021-07-17 00:14:38,612 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
4011 |
+
2021-07-17 00:14:40,613 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
4012 |
+
2021-07-17 00:14:42,614 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
4013 |
+
2021-07-17 00:14:44,614 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
4014 |
+
2021-07-17 00:14:46,615 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
4015 |
+
2021-07-17 00:14:52,554 DEBUG HandlerThread:799749 [handler.py:handle_request():124] handle_request: stop_status
|
4016 |
+
2021-07-17 00:14:52,555 DEBUG SenderThread:799749 [sender.py:send_request():193] send_request: stop_status
|
4017 |
+
2021-07-17 00:14:56,184 DEBUG SenderThread:799749 [sender.py:send():179] send: history
|
4018 |
+
2021-07-17 00:14:56,185 DEBUG SenderThread:799749 [sender.py:send():179] send: summary
|
4019 |
+
2021-07-17 00:14:56,185 INFO SenderThread:799749 [sender.py:_save_file():841] saving file wandb-summary.json with policy end
|
4020 |
+
2021-07-17 00:14:56,619 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/wandb-summary.json
|
4021 |
+
2021-07-17 00:14:58,620 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
4022 |
+
2021-07-17 00:15:00,621 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
4023 |
+
2021-07-17 00:15:02,622 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
4024 |
+
2021-07-17 00:15:04,623 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
4025 |
+
2021-07-17 00:15:05,706 DEBUG SenderThread:799749 [sender.py:send():179] send: stats
|
4026 |
+
2021-07-17 00:15:06,624 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
4027 |
+
2021-07-17 00:15:07,686 DEBUG HandlerThread:799749 [handler.py:handle_request():124] handle_request: stop_status
|
4028 |
+
2021-07-17 00:15:07,687 DEBUG SenderThread:799749 [sender.py:send_request():193] send_request: stop_status
|
4029 |
+
2021-07-17 00:15:08,625 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
4030 |
+
2021-07-17 00:15:16,327 DEBUG SenderThread:799749 [sender.py:send():179] send: history
|
4031 |
+
2021-07-17 00:15:16,327 DEBUG SenderThread:799749 [sender.py:send():179] send: summary
|
4032 |
+
2021-07-17 00:15:16,328 INFO SenderThread:799749 [sender.py:_save_file():841] saving file wandb-summary.json with policy end
|
4033 |
+
2021-07-17 00:15:16,628 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/wandb-summary.json
|
4034 |
+
2021-07-17 00:15:18,629 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
4035 |
+
2021-07-17 00:15:20,630 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
4036 |
+
2021-07-17 00:15:22,631 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
4037 |
+
2021-07-17 00:15:22,825 DEBUG HandlerThread:799749 [handler.py:handle_request():124] handle_request: stop_status
|
4038 |
+
2021-07-17 00:15:22,825 DEBUG SenderThread:799749 [sender.py:send_request():193] send_request: stop_status
|
4039 |
+
2021-07-17 00:15:24,632 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
4040 |
+
2021-07-17 00:15:26,633 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
4041 |
+
2021-07-17 00:15:35,779 DEBUG SenderThread:799749 [sender.py:send():179] send: stats
|
4042 |
+
2021-07-17 00:15:36,517 DEBUG SenderThread:799749 [sender.py:send():179] send: history
|
4043 |
+
2021-07-17 00:15:36,518 DEBUG SenderThread:799749 [sender.py:send():179] send: summary
|
4044 |
+
2021-07-17 00:15:36,518 INFO SenderThread:799749 [sender.py:_save_file():841] saving file wandb-summary.json with policy end
|
4045 |
+
2021-07-17 00:15:36,637 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/wandb-summary.json
|
4046 |
+
2021-07-17 00:15:37,637 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
4047 |
+
2021-07-17 00:15:37,995 DEBUG HandlerThread:799749 [handler.py:handle_request():124] handle_request: stop_status
|
4048 |
+
2021-07-17 00:15:37,995 DEBUG SenderThread:799749 [sender.py:send_request():193] send_request: stop_status
|
4049 |
+
2021-07-17 00:15:38,639 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
4050 |
+
2021-07-17 00:15:39,639 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
4051 |
+
2021-07-17 00:15:41,640 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
4052 |
+
2021-07-17 00:15:43,641 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
4053 |
+
2021-07-17 00:15:45,642 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
4054 |
+
2021-07-17 00:15:47,643 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
4055 |
+
2021-07-17 00:15:53,223 DEBUG HandlerThread:799749 [handler.py:handle_request():124] handle_request: stop_status
|
4056 |
+
2021-07-17 00:15:53,223 DEBUG SenderThread:799749 [sender.py:send_request():193] send_request: stop_status
|
4057 |
+
2021-07-17 00:15:56,714 DEBUG SenderThread:799749 [sender.py:send():179] send: history
|
4058 |
+
2021-07-17 00:15:56,714 DEBUG SenderThread:799749 [sender.py:send():179] send: summary
|
4059 |
+
2021-07-17 00:15:56,715 INFO SenderThread:799749 [sender.py:_save_file():841] saving file wandb-summary.json with policy end
|
4060 |
+
2021-07-17 00:15:57,647 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/wandb-summary.json
|
4061 |
+
2021-07-17 00:15:59,648 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
4062 |
+
2021-07-17 00:16:01,649 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
4063 |
+
2021-07-17 00:16:03,650 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
4064 |
+
2021-07-17 00:16:05,651 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
4065 |
+
2021-07-17 00:16:05,857 DEBUG SenderThread:799749 [sender.py:send():179] send: stats
|
4066 |
+
2021-07-17 00:16:07,651 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
4067 |
+
2021-07-17 00:16:08,361 DEBUG HandlerThread:799749 [handler.py:handle_request():124] handle_request: stop_status
|
4068 |
+
2021-07-17 00:16:08,361 DEBUG SenderThread:799749 [sender.py:send_request():193] send_request: stop_status
|
4069 |
+
2021-07-17 00:16:16,923 DEBUG SenderThread:799749 [sender.py:send():179] send: history
|
4070 |
+
2021-07-17 00:16:16,923 DEBUG SenderThread:799749 [sender.py:send():179] send: summary
|
4071 |
+
2021-07-17 00:16:16,924 INFO SenderThread:799749 [sender.py:_save_file():841] saving file wandb-summary.json with policy end
|
4072 |
+
2021-07-17 00:16:17,656 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
4073 |
+
2021-07-17 00:16:17,656 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/wandb-summary.json
|
4074 |
+
2021-07-17 00:16:19,657 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
4075 |
+
2021-07-17 00:16:21,657 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
4076 |
+
2021-07-17 00:16:23,511 DEBUG HandlerThread:799749 [handler.py:handle_request():124] handle_request: stop_status
|
4077 |
+
2021-07-17 00:16:23,512 DEBUG SenderThread:799749 [sender.py:send_request():193] send_request: stop_status
|
4078 |
+
2021-07-17 00:16:23,658 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
4079 |
+
2021-07-17 00:16:25,659 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
4080 |
+
2021-07-17 00:16:27,660 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
4081 |
+
2021-07-17 00:16:35,935 DEBUG SenderThread:799749 [sender.py:send():179] send: stats
|
4082 |
+
2021-07-17 00:16:37,195 DEBUG SenderThread:799749 [sender.py:send():179] send: history
|
4083 |
+
2021-07-17 00:16:37,195 DEBUG SenderThread:799749 [sender.py:send():179] send: summary
|
4084 |
+
2021-07-17 00:16:37,196 INFO SenderThread:799749 [sender.py:_save_file():841] saving file wandb-summary.json with policy end
|
4085 |
+
2021-07-17 00:16:37,665 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
4086 |
+
2021-07-17 00:16:37,665 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/wandb-summary.json
|
4087 |
+
2021-07-17 00:16:38,768 DEBUG HandlerThread:799749 [handler.py:handle_request():124] handle_request: stop_status
|
4088 |
+
2021-07-17 00:16:38,768 DEBUG SenderThread:799749 [sender.py:send_request():193] send_request: stop_status
|
4089 |
+
2021-07-17 00:16:39,665 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
4090 |
+
2021-07-17 00:16:40,666 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
4091 |
+
2021-07-17 00:16:42,667 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
4092 |
+
2021-07-17 00:16:44,668 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
4093 |
+
2021-07-17 00:16:46,669 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
4094 |
+
2021-07-17 00:16:48,670 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
4095 |
+
2021-07-17 00:16:53,933 DEBUG HandlerThread:799749 [handler.py:handle_request():124] handle_request: stop_status
|
4096 |
+
2021-07-17 00:16:53,934 DEBUG SenderThread:799749 [sender.py:send_request():193] send_request: stop_status
|
4097 |
+
2021-07-17 00:16:57,311 DEBUG SenderThread:799749 [sender.py:send():179] send: history
|
4098 |
+
2021-07-17 00:16:57,311 DEBUG SenderThread:799749 [sender.py:send():179] send: summary
|
4099 |
+
2021-07-17 00:16:57,312 INFO SenderThread:799749 [sender.py:_save_file():841] saving file wandb-summary.json with policy end
|
4100 |
+
2021-07-17 00:16:57,674 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/wandb-summary.json
|
4101 |
+
2021-07-17 00:16:58,674 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
4102 |
+
2021-07-17 00:16:59,675 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
4103 |
+
2021-07-17 00:17:00,675 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
4104 |
+
2021-07-17 00:17:02,676 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
4105 |
+
2021-07-17 00:17:04,677 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
4106 |
+
2021-07-17 00:17:06,010 DEBUG SenderThread:799749 [sender.py:send():179] send: stats
|
4107 |
+
2021-07-17 00:17:06,678 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
4108 |
+
2021-07-17 00:17:08,679 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
4109 |
+
2021-07-17 00:17:09,077 DEBUG HandlerThread:799749 [handler.py:handle_request():124] handle_request: stop_status
|
4110 |
+
2021-07-17 00:17:09,077 DEBUG SenderThread:799749 [sender.py:send_request():193] send_request: stop_status
|
4111 |
+
2021-07-17 00:17:17,451 DEBUG SenderThread:799749 [sender.py:send():179] send: history
|
4112 |
+
2021-07-17 00:17:17,451 DEBUG SenderThread:799749 [sender.py:send():179] send: summary
|
4113 |
+
2021-07-17 00:17:17,452 INFO SenderThread:799749 [sender.py:_save_file():841] saving file wandb-summary.json with policy end
|
4114 |
+
2021-07-17 00:17:17,683 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/wandb-summary.json
|
4115 |
+
2021-07-17 00:17:18,683 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
4116 |
+
2021-07-17 00:17:19,684 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
4117 |
+
2021-07-17 00:17:20,684 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
4118 |
+
2021-07-17 00:17:22,685 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
4119 |
+
2021-07-17 00:17:24,249 DEBUG HandlerThread:799749 [handler.py:handle_request():124] handle_request: stop_status
|
4120 |
+
2021-07-17 00:17:24,249 DEBUG SenderThread:799749 [sender.py:send_request():193] send_request: stop_status
|
4121 |
+
2021-07-17 00:17:24,686 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
4122 |
+
2021-07-17 00:17:26,687 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
4123 |
+
2021-07-17 00:17:28,688 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
4124 |
+
2021-07-17 00:17:36,085 DEBUG SenderThread:799749 [sender.py:send():179] send: stats
|
4125 |
+
2021-07-17 00:17:37,618 DEBUG SenderThread:799749 [sender.py:send():179] send: history
|
4126 |
+
2021-07-17 00:17:37,618 DEBUG SenderThread:799749 [sender.py:send():179] send: summary
|
4127 |
+
2021-07-17 00:17:37,619 INFO SenderThread:799749 [sender.py:_save_file():841] saving file wandb-summary.json with policy end
|
4128 |
+
2021-07-17 00:17:37,692 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/wandb-summary.json
|
4129 |
+
2021-07-17 00:17:38,693 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
4130 |
+
2021-07-17 00:17:39,429 DEBUG HandlerThread:799749 [handler.py:handle_request():124] handle_request: stop_status
|
4131 |
+
2021-07-17 00:17:39,430 DEBUG SenderThread:799749 [sender.py:send_request():193] send_request: stop_status
|
4132 |
+
2021-07-17 00:17:39,693 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
4133 |
+
2021-07-17 00:17:40,694 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
4134 |
+
2021-07-17 00:17:43,695 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
4135 |
+
2021-07-17 00:17:45,696 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
4136 |
+
2021-07-17 00:17:47,697 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
4137 |
+
2021-07-17 00:17:49,698 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
4138 |
+
2021-07-17 00:17:54,582 DEBUG HandlerThread:799749 [handler.py:handle_request():124] handle_request: stop_status
|
4139 |
+
2021-07-17 00:17:54,583 DEBUG SenderThread:799749 [sender.py:send_request():193] send_request: stop_status
|
4140 |
+
2021-07-17 00:17:57,806 DEBUG SenderThread:799749 [sender.py:send():179] send: history
|
4141 |
+
2021-07-17 00:17:57,807 DEBUG SenderThread:799749 [sender.py:send():179] send: summary
|
4142 |
+
2021-07-17 00:17:57,807 INFO SenderThread:799749 [sender.py:_save_file():841] saving file wandb-summary.json with policy end
|
4143 |
+
2021-07-17 00:17:58,702 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/wandb-summary.json
|
4144 |
+
2021-07-17 00:17:59,702 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
4145 |
+
2021-07-17 00:18:01,703 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
4146 |
+
2021-07-17 00:18:03,704 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
4147 |
+
2021-07-17 00:18:05,705 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
4148 |
+
2021-07-17 00:18:06,161 DEBUG SenderThread:799749 [sender.py:send():179] send: stats
|
4149 |
+
2021-07-17 00:18:07,706 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
4150 |
+
2021-07-17 00:18:09,707 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
4151 |
+
2021-07-17 00:18:09,716 DEBUG HandlerThread:799749 [handler.py:handle_request():124] handle_request: stop_status
|
4152 |
+
2021-07-17 00:18:09,716 DEBUG SenderThread:799749 [sender.py:send_request():193] send_request: stop_status
|
4153 |
+
2021-07-17 00:18:17,929 DEBUG SenderThread:799749 [sender.py:send():179] send: history
|
4154 |
+
2021-07-17 00:18:17,929 DEBUG SenderThread:799749 [sender.py:send():179] send: summary
|
4155 |
+
2021-07-17 00:18:17,930 INFO SenderThread:799749 [sender.py:_save_file():841] saving file wandb-summary.json with policy end
|
4156 |
+
2021-07-17 00:18:18,711 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/wandb-summary.json
|
4157 |
+
2021-07-17 00:18:19,712 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
4158 |
+
2021-07-17 00:18:21,712 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
4159 |
+
2021-07-17 00:18:23,713 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
4160 |
+
2021-07-17 00:18:24,846 DEBUG HandlerThread:799749 [handler.py:handle_request():124] handle_request: stop_status
|
4161 |
+
2021-07-17 00:18:24,846 DEBUG SenderThread:799749 [sender.py:send_request():193] send_request: stop_status
|
4162 |
+
2021-07-17 00:18:25,714 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
4163 |
+
2021-07-17 00:18:27,715 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
4164 |
+
2021-07-17 00:18:29,716 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
4165 |
+
2021-07-17 00:18:36,233 DEBUG SenderThread:799749 [sender.py:send():179] send: stats
|
4166 |
+
2021-07-17 00:18:38,094 DEBUG SenderThread:799749 [sender.py:send():179] send: history
|
4167 |
+
2021-07-17 00:18:38,094 DEBUG SenderThread:799749 [sender.py:send():179] send: summary
|
4168 |
+
2021-07-17 00:18:38,095 INFO SenderThread:799749 [sender.py:_save_file():841] saving file wandb-summary.json with policy end
|
4169 |
+
2021-07-17 00:18:38,720 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/wandb-summary.json
|
4170 |
+
2021-07-17 00:18:39,720 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
4171 |
+
2021-07-17 00:18:40,006 DEBUG HandlerThread:799749 [handler.py:handle_request():124] handle_request: stop_status
|
4172 |
+
2021-07-17 00:18:40,007 DEBUG SenderThread:799749 [sender.py:send_request():193] send_request: stop_status
|
4173 |
+
2021-07-17 00:18:40,721 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
4174 |
+
2021-07-17 00:18:41,721 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
4175 |
+
2021-07-17 00:18:43,722 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
4176 |
+
2021-07-17 00:18:45,723 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
4177 |
+
2021-07-17 00:18:47,724 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
4178 |
+
2021-07-17 00:18:55,183 DEBUG HandlerThread:799749 [handler.py:handle_request():124] handle_request: stop_status
|
4179 |
+
2021-07-17 00:18:55,184 DEBUG SenderThread:799749 [sender.py:send_request():193] send_request: stop_status
|
4180 |
+
2021-07-17 00:18:58,229 DEBUG SenderThread:799749 [sender.py:send():179] send: history
|
4181 |
+
2021-07-17 00:18:58,229 DEBUG SenderThread:799749 [sender.py:send():179] send: summary
|
4182 |
+
2021-07-17 00:18:58,230 INFO SenderThread:799749 [sender.py:_save_file():841] saving file wandb-summary.json with policy end
|
4183 |
+
2021-07-17 00:18:58,729 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/wandb-summary.json
|
4184 |
+
2021-07-17 00:18:59,729 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
4185 |
+
2021-07-17 00:19:00,730 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
4186 |
+
2021-07-17 00:19:01,730 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
4187 |
+
2021-07-17 00:19:04,732 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
4188 |
+
2021-07-17 00:19:06,309 DEBUG SenderThread:799749 [sender.py:send():179] send: stats
|
4189 |
+
2021-07-17 00:19:06,732 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
4190 |
+
2021-07-17 00:19:08,733 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
4191 |
+
2021-07-17 00:19:10,319 DEBUG HandlerThread:799749 [handler.py:handle_request():124] handle_request: stop_status
|
4192 |
+
2021-07-17 00:19:10,319 DEBUG SenderThread:799749 [sender.py:send_request():193] send_request: stop_status
|
4193 |
+
2021-07-17 00:19:18,396 DEBUG SenderThread:799749 [sender.py:send():179] send: history
|
4194 |
+
2021-07-17 00:19:18,396 DEBUG SenderThread:799749 [sender.py:send():179] send: summary
|
4195 |
+
2021-07-17 00:19:18,397 INFO SenderThread:799749 [sender.py:_save_file():841] saving file wandb-summary.json with policy end
|
4196 |
+
2021-07-17 00:19:18,737 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/wandb-summary.json
|
4197 |
+
2021-07-17 00:19:20,738 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
4198 |
+
2021-07-17 00:19:22,739 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
4199 |
+
2021-07-17 00:19:24,740 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
4200 |
+
2021-07-17 00:19:25,542 DEBUG HandlerThread:799749 [handler.py:handle_request():124] handle_request: stop_status
|
4201 |
+
2021-07-17 00:19:25,542 DEBUG SenderThread:799749 [sender.py:send_request():193] send_request: stop_status
|
4202 |
+
2021-07-17 00:19:26,741 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
4203 |
+
2021-07-17 00:19:28,742 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
4204 |
+
2021-07-17 00:19:36,386 DEBUG SenderThread:799749 [sender.py:send():179] send: stats
|
4205 |
+
2021-07-17 00:19:38,567 DEBUG SenderThread:799749 [sender.py:send():179] send: history
|
4206 |
+
2021-07-17 00:19:38,567 DEBUG SenderThread:799749 [sender.py:send():179] send: summary
|
4207 |
+
2021-07-17 00:19:38,567 INFO SenderThread:799749 [sender.py:_save_file():841] saving file wandb-summary.json with policy end
|
4208 |
+
2021-07-17 00:19:38,746 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/wandb-summary.json
|
4209 |
+
2021-07-17 00:19:40,740 DEBUG HandlerThread:799749 [handler.py:handle_request():124] handle_request: stop_status
|
4210 |
+
2021-07-17 00:19:40,740 DEBUG SenderThread:799749 [sender.py:send_request():193] send_request: stop_status
|
4211 |
+
2021-07-17 00:19:40,747 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
4212 |
+
2021-07-17 00:19:42,748 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
4213 |
+
2021-07-17 00:19:44,749 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
4214 |
+
2021-07-17 00:19:46,750 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
4215 |
+
2021-07-17 00:19:48,751 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
4216 |
+
2021-07-17 00:19:55,882 DEBUG HandlerThread:799749 [handler.py:handle_request():124] handle_request: stop_status
|
4217 |
+
2021-07-17 00:19:55,883 DEBUG SenderThread:799749 [sender.py:send_request():193] send_request: stop_status
|
4218 |
+
2021-07-17 00:19:58,677 DEBUG SenderThread:799749 [sender.py:send():179] send: history
|
4219 |
+
2021-07-17 00:19:58,677 DEBUG SenderThread:799749 [sender.py:send():179] send: summary
|
4220 |
+
2021-07-17 00:19:58,678 INFO SenderThread:799749 [sender.py:_save_file():841] saving file wandb-summary.json with policy end
|
4221 |
+
2021-07-17 00:19:58,756 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/wandb-summary.json
|
4222 |
+
2021-07-17 00:20:00,757 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
4223 |
+
2021-07-17 00:20:02,758 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
4224 |
+
2021-07-17 00:20:04,759 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
4225 |
+
2021-07-17 00:20:06,464 DEBUG SenderThread:799749 [sender.py:send():179] send: stats
|
4226 |
+
2021-07-17 00:20:06,760 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
4227 |
+
2021-07-17 00:20:08,761 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
4228 |
+
2021-07-17 00:20:10,762 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
4229 |
+
2021-07-17 00:20:11,013 DEBUG HandlerThread:799749 [handler.py:handle_request():124] handle_request: stop_status
|
4230 |
+
2021-07-17 00:20:11,014 DEBUG SenderThread:799749 [sender.py:send_request():193] send_request: stop_status
|
4231 |
+
2021-07-17 00:20:18,829 DEBUG SenderThread:799749 [sender.py:send():179] send: history
|
4232 |
+
2021-07-17 00:20:18,829 DEBUG SenderThread:799749 [sender.py:send():179] send: summary
|
4233 |
+
2021-07-17 00:20:18,830 INFO SenderThread:799749 [sender.py:_save_file():841] saving file wandb-summary.json with policy end
|
4234 |
+
2021-07-17 00:20:19,766 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/wandb-summary.json
|
4235 |
+
2021-07-17 00:20:20,766 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
4236 |
+
2021-07-17 00:20:22,767 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
4237 |
+
2021-07-17 00:20:25,768 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
4238 |
+
2021-07-17 00:20:26,199 DEBUG HandlerThread:799749 [handler.py:handle_request():124] handle_request: stop_status
|
4239 |
+
2021-07-17 00:20:26,200 DEBUG SenderThread:799749 [sender.py:send_request():193] send_request: stop_status
|
4240 |
+
2021-07-17 00:20:27,769 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
4241 |
+
2021-07-17 00:20:29,771 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
4242 |
+
2021-07-17 00:20:36,538 DEBUG SenderThread:799749 [sender.py:send():179] send: stats
|
4243 |
+
2021-07-17 00:20:38,948 DEBUG SenderThread:799749 [sender.py:send():179] send: history
|
4244 |
+
2021-07-17 00:20:38,948 DEBUG SenderThread:799749 [sender.py:send():179] send: summary
|
4245 |
+
2021-07-17 00:20:38,948 INFO SenderThread:799749 [sender.py:_save_file():841] saving file wandb-summary.json with policy end
|
4246 |
+
2021-07-17 00:20:39,775 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/wandb-summary.json
|
4247 |
+
2021-07-17 00:20:40,776 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
4248 |
+
2021-07-17 00:20:41,460 DEBUG HandlerThread:799749 [handler.py:handle_request():124] handle_request: stop_status
|
4249 |
+
2021-07-17 00:20:41,460 DEBUG SenderThread:799749 [sender.py:send_request():193] send_request: stop_status
|
4250 |
+
2021-07-17 00:20:41,776 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
4251 |
+
2021-07-17 00:20:43,777 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
4252 |
+
2021-07-17 00:20:45,778 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
4253 |
+
2021-07-17 00:20:47,779 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
wandb/run-20210716_223350-8eukt20m/run-8eukt20m.wandb
CHANGED
Binary files a/wandb/run-20210716_223350-8eukt20m/run-8eukt20m.wandb and b/wandb/run-20210716_223350-8eukt20m/run-8eukt20m.wandb differ
|
|