Skip to content

A
angle
Commit 0b200680 by Jamie Madill
Options

Suppress failing dEQP tests.

With the suppression changes from 5111a062, a few were removed that seem to fail only on certain configurations. Reinstate the failure expectations for the dEQP bots. BUG=angleproject:1236 Change-Id: Ib642c60a7871f7994ae1f0082f22533e6650f082 Reviewed-on: https://chromium-review.googlesource.com/315090 Tryjob-Request: Jamie Madill <jmadill@chromium.org> Reviewed-by: 's avatarGeoff Lang <geofflang@chromium.org> Reviewed-by: 's avatarCorentin Wallez <cwallez@chromium.org> Tested-by: 's avatarJamie Madill <jmadill@chromium.org>
parent f01ac9fb
Showing with 25 additions and 19 deletions
src/tests/deqp_support/deqp_gles2_test_expectations.txt
...@@ -23,6 +23,23 @@ ...@@ -23,6 +23,23 @@
// 91531 MAC WIN LINUX : conformance_more_* = SKIP // 91531 MAC WIN LINUX : conformance_more_* = SKIP
// 91532 MAC NVIDIA 0x0640 : tex_image_and_sub_image_2d_with_video = PASS FAIL // 91532 MAC NVIDIA 0x0640 : tex_image_and_sub_image_2d_with_video = PASS FAIL
// TODO(jmadill): Figure out why these fail on the bots, but not locally.
1018 WIN : dEQP-GLES2.functional.shaders.invariance.highp.loop_2 = FAIL
1018 WIN : dEQP-GLES2.functional.shaders.invariance.mediump.loop_2 = FAIL
// Skip these tests due to timeouts
1034 WIN LINUX MAC : dEQP-GLES2.functional.flush_finish.* = SKIP
// Don't run these tests for faster turnover
998 WIN LINUX MAC : dEQP-GLES2.performance.* = SKIP
998 WIN LINUX MAC : dEQP-GLES2.stress.* = SKIP
////////////////////////////////////////////////////////////////////////////////
//
// Temporary entries: they should be removed once the bugs are fixed.
//
////////////////////////////////////////////////////////////////////////////////
// TODO(jmadill): triage these into temporary and permanent suppressions // TODO(jmadill): triage these into temporary and permanent suppressions
// Windows only failures // Windows only failures
...@@ -182,8 +199,6 @@ ...@@ -182,8 +199,6 @@
504 LINUX : dEQP-GLES2.functional.uniform_api.value.assigned.by_pointer.render.array_in_struct.sampler2D_samplerCube_both = FAIL 504 LINUX : dEQP-GLES2.functional.uniform_api.value.assigned.by_pointer.render.array_in_struct.sampler2D_samplerCube_both = FAIL
504 LINUX : dEQP-GLES2.functional.uniform_api.value.assigned.by_pointer.render.nested_structs_arrays.sampler2D_samplerCube_both = FAIL 504 LINUX : dEQP-GLES2.functional.uniform_api.value.assigned.by_pointer.render.nested_structs_arrays.sampler2D_samplerCube_both = FAIL
504 LINUX : dEQP-GLES2.functional.uniform_api.value.assigned.by_pointer.render.nested_structs_arrays.sampler2D_samplerCube_fragment = FAIL 504 LINUX : dEQP-GLES2.functional.uniform_api.value.assigned.by_pointer.render.nested_structs_arrays.sampler2D_samplerCube_fragment = FAIL
1034 LINUX : dEQP-GLES2.functional.flush_finish.flush = FAIL
1034 LINUX : dEQP-GLES2.functional.flush_finish.finish = FAIL
1019 LINUX : dEQP-GLES2.functional.texture.size.cube.256x256_rgba4444 = FAIL 1019 LINUX : dEQP-GLES2.functional.texture.size.cube.256x256_rgba4444 = FAIL
1019 LINUX : dEQP-GLES2.functional.texture.size.cube.512x512_rgba4444 = FAIL 1019 LINUX : dEQP-GLES2.functional.texture.size.cube.512x512_rgba4444 = FAIL
1020 LINUX : dEQP-GLES2.functional.texture.mipmap.2d.projected.nearest_linear* = FAIL 1020 LINUX : dEQP-GLES2.functional.texture.mipmap.2d.projected.nearest_linear* = FAIL
...@@ -223,8 +238,6 @@ ...@@ -223,8 +238,6 @@
1143 MAC : dEQP-GLES2.functional.texture.size.cube.512x512_rgba4444 = FAIL 1143 MAC : dEQP-GLES2.functional.texture.size.cube.512x512_rgba4444 = FAIL
1143 MAC : dEQP-GLES2.functional.texture.mipmap.cube.projected.linear_linear = FAIL 1143 MAC : dEQP-GLES2.functional.texture.mipmap.cube.projected.linear_linear = FAIL
1143 MAC : dEQP-GLES2.functional.texture.specification.basic_copyteximage2d.cube_* = FAIL 1143 MAC : dEQP-GLES2.functional.texture.specification.basic_copyteximage2d.cube_* = FAIL
1143 MAC : dEQP-GLES2.functional.flush_finish.flush = FAIL
1143 MAC : dEQP-GLES2.functional.flush_finish.finish = FAIL
// Windows and Linux failures // Windows and Linux failures
1015 WIN LINUX : dEQP-GLES2.functional.shaders.functions.invalid.local_function_prototype_vertex = FAIL 1015 WIN LINUX : dEQP-GLES2.functional.shaders.functions.invalid.local_function_prototype_vertex = FAIL
...@@ -286,16 +299,3 @@ ...@@ -286,16 +299,3 @@
1030 WIN LINUX MAC : dEQP-GLES2.functional.attribute_location.bind_aliasing.cond_mat4_offset_1 = FAIL 1030 WIN LINUX MAC : dEQP-GLES2.functional.attribute_location.bind_aliasing.cond_mat4_offset_1 = FAIL
1030 WIN LINUX MAC : dEQP-GLES2.functional.attribute_location.bind_aliasing.max_cond_mat4 = FAIL 1030 WIN LINUX MAC : dEQP-GLES2.functional.attribute_location.bind_aliasing.max_cond_mat4 = FAIL
1032 WIN LINUX MAC : dEQP-GLES2.functional.state_query.shader.program_attached_shaders = FAIL 1032 WIN LINUX MAC : dEQP-GLES2.functional.state_query.shader.program_attached_shaders = FAIL
// Skip this test due to timeouts
1034 WIN LINUX MAC : dEQP-GLES2.functional.flush_finish.finish_wait = SKIP
// Don't run these tests for faster turnover
998 WIN LINUX MAC : dEQP-GLES2.performance.* = SKIP
998 WIN LINUX MAC : dEQP-GLES2.stress.* = SKIP
////////////////////////////////////////////////////////////////////////////////
//
// Temprory entries: they should be removed once the bugs are fixed.
//
////////////////////////////////////////////////////////////////////////////////
src/tests/deqp_support/deqp_gles3_test_expectations.txt
...@@ -26,9 +26,12 @@ ...@@ -26,9 +26,12 @@
// Don't run these tests for faster turnover // Don't run these tests for faster turnover
998 WIN LINUX : dEQP-GLES3.performance.* = SKIP 998 WIN LINUX : dEQP-GLES3.performance.* = SKIP
998 WIN LINUX : dEQP-GLES3.stress.* = SKIP 998 WIN LINUX : dEQP-GLES3.stress.* = SKIP
1101 WIN : dEQP-GLES3.functional.flush_finish.* = FAIL
// TODO(jmadill): Figure out why this fails on the bots, but not locally. // TODO(jmadill): Figure out why these fail on the bots, but not locally.
1108 WIN : dEQP-GLES3.functional.shaders.struct.local.dynamic_loop_struct_array_fragment = FAIL 1108 WIN : dEQP-GLES3.functional.shaders.struct.local.dynamic_loop_struct_array_fragment = FAIL
1094 WIN : dEQP-GLES3.functional.shaders.invariance.highp.loop_2 = FAIL
1094 WIN : dEQP-GLES3.functional.shaders.invariance.mediump.loop_2 = FAIL
// We can't support distinct texture sizes in D3D11. // We can't support distinct texture sizes in D3D11.
1097 WIN : dEQP-GLES3.functional.fbo.completeness.size.distinct = FAIL 1097 WIN : dEQP-GLES3.functional.fbo.completeness.size.distinct = FAIL
...@@ -42,6 +45,10 @@ ...@@ -42,6 +45,10 @@
// TODO(jmadill): Find why this fails when run in a certain sequence, but not singly. // TODO(jmadill): Find why this fails when run in a certain sequence, but not singly.
1098 WIN : dEQP-GLES3.functional.uniform_api.random.50 = FAIL 1098 WIN : dEQP-GLES3.functional.uniform_api.random.50 = FAIL
// TODO(jmadill): This seems to fail only on certain NVidia configurations.
1097 WIN : dEQP-GLES3.functional.fbo.blit.conversion.rgba8_to_rgb565 = FAIL
1097 WIN : dEQP-GLES3.functional.fbo.blit.default_framebuffer.rgb565 = FAIL
// TODO(jmadill): triage these into permanent and temporary failures // TODO(jmadill): triage these into permanent and temporary failures
1089 WIN : dEQP-GLES3.functional.shaders.functions.invalid.local_function_prototype_vertex = FAIL 1089 WIN : dEQP-GLES3.functional.shaders.functions.invalid.local_function_prototype_vertex = FAIL
...@@ -822,7 +829,6 @@ ...@@ -822,7 +829,6 @@
1101 WIN : dEQP-GLES3.functional.state_query.shader.program_binary = FAIL 1101 WIN : dEQP-GLES3.functional.state_query.shader.program_binary = FAIL
1101 WIN : dEQP-GLES3.functional.polygon_offset.fixed16_render_with_units = FAIL 1101 WIN : dEQP-GLES3.functional.polygon_offset.fixed16_render_with_units = FAIL
1101 WIN : dEQP-GLES3.functional.polygon_offset.fixed24_render_with_units = FAIL 1101 WIN : dEQP-GLES3.functional.polygon_offset.fixed24_render_with_units = FAIL
1101 WIN : dEQP-GLES3.functional.flush_finish.flush = FAIL
1101 WIN : dEQP-GLES3.functional.lifetime.gen.transform_feedback = FAIL 1101 WIN : dEQP-GLES3.functional.lifetime.gen.transform_feedback = FAIL
1101 WIN : dEQP-GLES3.functional.lifetime.gen.vertex_array = FAIL 1101 WIN : dEQP-GLES3.functional.lifetime.gen.vertex_array = FAIL
1101 WIN : dEQP-GLES3.functional.lifetime.attach.deleted_input.buffer_vertex_array = FAIL 1101 WIN : dEQP-GLES3.functional.lifetime.attach.deleted_input.buffer_vertex_array = FAIL
......
Markdown is supported
0% or
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment